Search NASASearch

SEARCH · Search NASA

Results for “Program Evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Training Evaluation: A Case Study of Measuring Impact and ROI

The purpose of this case study was to evaluate the Compliance Officer/Coordinator (CO/CC) training program using Phillips’ approach to training evaluation. INL Learning Performance Consultants (LPCs) applied the ROI Methodology to measure the effectiveness of the CO/CC training program. INL CO/CCs participated in focus groups to provide feedback on their learning, enablers and barriers to applying what they learned, and opportunities to improve the CO/CC learning experience. With collaboration from the CO/CC training program owner, the LPCs demonstrated the business impact and return on investment (ROI) of the CO/CC training program. Included are training program recommendations and lessons learned using the ROI Methodology.

99 GENERAL AND MISCELLANEOUS

Hanford Site Rare Plant Monitoring Report for Calendar Year 2023-2024

This report summarizes rare plant monitoring data collected in calendar years (CY) 2023 through CY 2024 and provides management recommendations accordingly. DOE/RL-2021-35, Central Hanford Rare Plant Management Plan, guides the approach to rare plant monitoring and management at the Hanford Site. In CYs 2023 and 2024, rare plant monitoring efforts occurred on the portion of the Hanford Site managed by the Hanford Field Office (HFO; Figure 1-1), referred to herein as Central Hanford. The goal of monitoring is to collect data to evaluate the conservation status of rare plant species. Surveys conducted in CY 2023 through CY 2024 built on previous monitoring efforts, tracking the abundance and distribution of rare plants at Central Hanford. Results from previous monitoring efforts are included for reference. Monitoring data are submitted to the Washington Natural Heritage Program (WNHP) to evaluate statewide conservation statuses.

54 ENVIRONMENTAL SCIENCES

Overview of the Neutron Radiography Reactor (NRAD) for Neutron Imaging and In-Core Experiment Capabilities at Idaho National Laboratory

NRAD is a 250-kilowatt TRIGA research reactor that first went online at INL in 1977. (TRIGA stands for Training, Research, Isotopes, General Atomics.) Historically, NRAD was utilized as a neutron radiography reactor that provides comprehensive, non-destructive information about the internal condition of irradiated nuclear fuel. Idaho National Laboratory (INL) has multiple nuclear fuels research and development programs that routinely evaluate irradiated fuels using neutron radiography at NRAD. In recent years, NRAD has gone through a transformation from the single purpose radiography reactor for which it was designed into a multipurpose research reactor, and expanding its in-core irradiation capabilities to support a broader mission for the US Department of Energy (DOE) Nuclear Energy (NE) programs, Basic Energy Science (BES) Programs, as well as Fusion Energy programs. NRAD is a designated user facility under the DOE Nuclear Science User Facility (NSUF) program, and is available for access for general public via a competitive proposal process. More information about NSUF and NRAD are available from the website: https://nsuf.inl.gov/Home/Facility/654.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS

Technical Assessment of the Application of Digital Twin and Prognostic Tools for Condition Monitoring

This report was prepared for the U.S. Nuclear Regulatory Commission (NRC) to present use cases of the application of advanced technologies toward meeting the current and future regulatory requirements for maintenance and condition monitoring of structures, systems, and components (SSCs). The advanced technologies considered in this work, collectively referred to as digital twin (DT) technologies, are advanced sensors and instrumentation, data analytics, machine learning and artificial intelligence (ML/AI), and physics-based models. The report presents two use cases of reactor coolant pumps (RCPs) and heat pipes in nuclear power plants (NPPs) with technical and regulatory considerations and opportunities in using advanced technologies for conditional monitoring. Key findings from the exploration of these considerations are as follows: - Uncertainties in sensor data and model predictions must be rigorously addressed through validation and verification processes - Regulatory compliance is paramount, necessitating data driven models to be developed in line with existing codes and standards, as well as considering potential future guidelines for advanced reactors - Explainability and transparency in ML/AI models are essential for developing operator trust and regulatory review, including methods that enhance the interpretability of complex data-driven predictions - Condition monitoring programs must be evaluated for their effectiveness in reducing maintenance-preventable function failures (MPFF) and aligning with plant performance criteria - The deployment of advanced technologies for condition monitoring could lead to a transition from periodic to continuous monitoring, thereby optimizing maintenance schedules - Collaborative efforts between industry stakeholders, regulatory bodies, and technology developers are crucial for the successful adoption of advanced technologies for condition monitoring systems in nuclear facilities In summary, the introduction of advanced technologies into condition monitoring programs represents a significant leap forward in the domain of NPP maintenance. By harnessing the capabilities of advanced sensors, data analytics, and ML/AI, NPP operators can transition from a time-based to a condition-based maintenance approach. This shift can potentially enhance the reliability and safety of critical plant components while optimizing maintenance efforts and minimizing unnecessary outages. The NRC is continuing to explore the regulatory aspects of advanced technologies as part of inservice inspection and inservice testing (ISI and IST) programs by pursuing additional research in this technical area.

22 - GENERAL STUDIES OF NUCLEAR REACTORS

Low-Temperature Plasma-Based Metrology of Lithium-Ion Battery Electrode Materials (CRADA Final Report)

As part of the Cyclotron Road program, SirenOpt Inc. evaluated its low-temperature plasma-based metrology sensor prototype for measuring multiple critical properties of lithium-ion battery electrode materials in parallel and in real-time. Cost-effective, minimal-waste manufacturing of high-performance battery electrode materials will be vital for achieving society’s net-zero carbon emission goals. Because existing electrode metrology sensors cannot operate within most sections of manufacturing lines, manufacturers often complete hundreds of processing steps before they can test their products and detect problems. When manufacturers perform these offline tests, they typically only test a small portion of the manufactured products. Current electrode manufacturing thus often yields many low-quality products, or off-spec products that must be thrown away all together. For example, at least 6% of the total lithium-ion battery manufacturing cost (i.e., over $250 million/year for the average gigafactory) is devoted to processing defective electrodes that are not scrapped until performance tests are failed during late-stage quality control checks. Electrode variability also leads manufacturers to build extra cells into battery packs to reduce the risk of poor performance. For example, many electric vehicle (EV) manufacturers include up to 10% more cells than needed, which substantially increases the cost and weight of the final EV product. The SirenOpt sensor can potentially enable early detection of poorly manufactured electrodes and allow them to be removed earlier from manufacturing lines, which can save battery manufacturers (hundreds of) millions of dollars per year. The sensor can further be used to improve product quality by accelerating R&D and process optimization, improving quality control, and enabling real-time process control. Overall, a real-time, in-situ metrology strategy can create unprecedented opportunities for implementation of smart manufacturing practices and advanced quality and process control solutions to realize higher battery electrode throughput and performance.

25 ENERGY STORAGE

Cyber-Informed Engineering Requirements Framework Use Cases

The requirement analysis use case effort leverages the Cyber-Informed Engineering (CIE) requirements framework to examine two real-world scenarios: Battery Energy Storage System (BESS) installation at the Flatirons Campus, NLR; SCADA improvement program. This work evaluates the existing requirements for each use case, applies the CIE requirements framework, and assesses the benefits and enhancements gained compared to the current requirements. The results will advance CIE from concept to practical application by identifying key opportunities for integrating CIE principles into established engineering workflows during the requirements phase.

97 MATHEMATICS AND COMPUTING

Pandora-based muon neutrino disappearance search in the SBN program with 1muonNp quasi-elastic like channel

The Short-Baseline Neutrino (SBN) program at Fermilab aims to perform a definitive search for light sterile neutrinos using multiple liquid argon time projection chamber detectors. We present the status of an analysis of muon neutrino charged-current interactions in two SBN detectors (SBND and ICARUS), selecting fully contained events with one muon and at least one proton in the final state, inspired by the recent ICARUS standalone results. This topology-driven selection reduces dependence on neutrino interaction cross-section modeling while preserving high statistics and good neutrino energy resolution, enabled by robust reconstruction and particle identification. Fully contained events enable precise kinematic reconstruction and support relative measurements between detectors, directly addressing the core goals of the SBN program. A detailed evaluation of systematic uncertainties is currently underway, with the objective of reducing the dominant systematics to the percent level. The current status of this analysis, with a particular focus on the event selection performance, will be presented in this poster.

Artero Pons, Maria [Padua U.; INFN, Padua]

Nondestructive Modular Leak Detection in 3D Printed 316L Stainless Steel Pipes via Laser Powder Bed Fusion

This research investigates the leak detection features of 316L Stainless Steel pipe structures manufactured via Laser Powder Bed Fusion (LPBF). This work involves the design of a modular sensor system integrating nondestructive evaluation (NDE) methods, including thermal imaging and ultrasonic frequency detection to detect and characterize leaks in components. This aims to improve leak detection sensitivity within medium-pressure gas systems, during continuous operation without halting flow or introducing safety risks. The system could be adaptable for use on unmanned aerial vehicles (UAVs), enabling remote leak detection in active environments. A custom pneumatic system incorporating temperature and pressure sensors was assembled to detect leaks in LPBF-printed 316L SS tee pipes. Experimental results and simulations confirm the system’s effectiveness in leak detection and material evaluation. This research program also integrated a Python-based image recognition platform based on a metallography and optical microscopy to assess the porosity and complement the leak detection data on the printed structures. This allows a detailed analysis of pore distribution and internal leak paths, which could compromise structural integrity, critical for quality control during manufacturing. Findings suggest that the investigated approach holds potential for enhancing leak detection technologies and adapt them for advanced manufactured parts.

36 MATERIALS SCIENCE

Draft Prototype Microreactor Transportation Safety Program

Microreactors are compact reactors capable of producing less than 50 megawatts of electrical energy. Typically, these reactors are factory-fabricated and designed to be easily transportable by truck, rail, vessel, or air. Microreactor designs often assume that the unit can be transported containing either unirradiated or irradiated fuel. The interest in microreactors is driven by several factors, including the need to generate power on at remote locations, at military installations, at facilities such as data centers, and in areas recovering from natural disasters. The U.S. Department of Defense is actively pursuing the microreactor concept to meet the increasing energy demands of military operations that require portable and dense power sources. Commercial vendors are also exploring microreactor concepts. The report Microreactor Transportation Emergency Planning Challenges (Maheras et al. 2024) outlined the emergency planning challenges associated with the transportation of microreactors by road, rail, and by barge/ship. The successful commercial deployment and redeployment of microreactors will also require the development of microreactor transportation safety programs. The elements in these safety programs are not specific to microreactors; however, the transport of microreactors may pose unique challenges in these areas. This report builds on the report Microreactor Transportation Emergency Planning Challenges (Maheras et al. 2024) and develops the elements of a prototype microreactor transportation safety program that describes the elements that should be contained vendor-developed microreactor transportation safety programs, identifying the unique elements associated with microreactor transport. This will provide vendors and their transportation contractors a basis for their transportation planning and will accelerate the commercial deployment and redeployment of microreactors by identifying those issues unique to microreactor transport. The emphasis of this report is on highway transport of microreactors. This is based on a U.S. Nuclear Regulatory Commission transportation package approval strategy of crawl-walk-run, where transport by highway is evaluated first (Coles et al. 2021, 2024, Maheras et al. 2021), then other surface modes (rail and barge/ship), and finally air transport. Evaluation of maritime transport of microreactors was recently initiated (Rigato et al. 2024, Maheras et al. 2025). The report first discusses microreactors in general and microreactor transportation safety program planning assumptions. The report then provides a description of the transportation safety planning process and provides an extensive discussion of the elements of transportation safety programs. Specific elements examined included transportation roles and responsibilities, transportation planning, transportation mode and route selection, carrier selection, transportation packaging, advance notification of shipments, public information and communications, emergency response plans and procedures, inspections, security, safe parking, shipment tracking, weather and road conditions, medical preparedness, training and exercises, and program evaluation. The report then identifies the unique elements of a transportation safety program associated with microreactor transport. These unique elements were in the areas of: the unusual nature of microreactor designs, compensatory measures, increased radiation dose rates in the vicinity of microreactors, transportation package approval versus 10 CFR 50.59, and the use of a risk-informed transportation package approval process.

22 GENERAL STUDIES OF NUCLEAR REACTORS

A Cultural Resource Survey of 110.55 Acres at the Coyote Test Field, Sandia National Laboratories, Kirtland Air Force Base, Bernalillo County, Albuquerque, New Mexico

This report presents the results of a Section 110 cultural resource survey of Sandia National Laboratories’ (Sandia) 9930 and 9939 Complexes, in the Coyote Test Field (CTF), located on lands permitted to the Department of Energy (DOE) by the Department of Defense (DOD), Kirtland Air Force Base (KAFB), Bernalillo County, Albuquerque, New Mexico. The Department of Energy, National Nuclear Security Administration Sandia Field Office (DOE/NNSA SFO) and National Technology and Engineering Solutions of Sandia, LLC, in accordance with Section 110 and Section 106 of the National Historic Preservation Act (NHPA) and its implementing regulations 36 C.F.R. Part 800, states that every federal agency must establish their own historic preservation program for the identification, evaluation, and protection of historic properties and to ensure that historic preservation is fully integrated into the ongoing programs of federal agencies. Sandia’s Cultural Resources Program (CRP) establishes areas of potential effects based upon projected Sandia mission needs. Some of these areas have no immediate undertakings planned but are in areas where undertakings can happen at a future date.

54 ENVIRONMENTAL SCIENCES

Cross Section Evaluation for Exclusive Channels of K+Λ and K+Σ0 Electroproduction off Protons Using CLAS Detector Data

In this work, a method for evaluating the cross sections of electroproduction of K+Λ0 and K+Σ0 off protons in the region of invariant masses of final hadrons MK + MY <W < 2.65 GeV (MK and MY being the masses of the kaon and hyperon, respectively) and squares of four-momentum transfers of virtual photons, i.e., photon virtualities 0 < Q2 < 5 GeV2, is developed based on experimental data of these exclusive channels’ cross sections measured by the CLAS detector in Hall B at Jefferson Lab. A set of algorithms has been implemented to evaluate the differential cross sections of these channels, along with their statistical and systematic uncertainties. A program was developed for the evaluation of differential cross sections and structure functions using C++ and Python libraries. An interactive website was created for working with the program, enabling the analysis of one-dimensional and two-dimensional dependences of structure functions and differential cross sections. The evaluation of differential cross sections for the K+Λ and K+Σ0 electroproduction channels is necessary for extracting the structure function σLT from the data on the polarization asymmetry of electroproduction reactions of these final states with longitudinally polarized electrons. The obtained results are also important for the development of realistic Monte Carlo event generators in planning future experiments and for evaluating the efficiency of detecting final particles when extracting reaction cross sections from experimental data.

Golda, A. V.

Measuring impacts of California agri-environmental programs using field-scale satellite data

In the past decade, California has invested over $\$$200 million in direct grants to growers to support the adoption of agricultural practices that save water and/or improve soil health while also reducing greenhouse gas emissions. Ex-post evaluation of agri-environmental outcomes of these grant programs, however, is limited. We use satellite data to monitor changes in field-level consumptive water use and greenness (i.e. normalized difference vegetation index), a proxy for agricultural productivity, for the most frequently funded crop-types (almonds, grapes, and walnuts) in two California Department of Food and Agriculture programs. Nearly 600 fields receiving funding during the 2014–2022 period were analyzed using two causal inference methods. Fields that received grants to both upgrade irrigation systems and install irrigation water management sensors showed reduced consumptive water use and greenness by an average of 3.5% and 4.2%, respectively (significant at the 10% level). In contrast, we find that the adoption of only irrigation water management sensors, which are designed to inform irrigation scheduling and management, resulted in an average increase of 4.1% and 4.8% in consumptive water use and greenness respectively (significant at the 5% level). We find negligible effects for either consumptive water use or greenness when both pump efficiency upgrades and sensors were implemented. We further find that grants for compost addition and cover cropping led to small greenness increases of 1.7% and 2.8% respectively (significant at the 10% level) and had insignificant effects on consumptive water use. Our analysis of five agri-environmental program interventions reveals that several practice outcomes may be at odds with stated program goals of reducing water use while maintaining or improving agricultural productivity.

agriculture

Removal of deuterium retained in boron powder by oxygen or high-temperature bakeout

Fuel retention in dust accumulated in fusion devices is a potential operational hazard. Boronization is one of the leading wall-conditioning candidates for future fusion devices. Fuel retention characteristics of boron dust must be studied to accurately understand the potential hazards of boron dust in fusion devices. We evaluated the retention of deuterium (D) in commercially available boron powder as a proxy for tritium retention in boron dust. Diffuse reflectance infrared Fourier transform spectroscopy revealed that boron powder between 300 and 500 K exposed to neutral hydrogen (H 2 ) gas retains H via B-H bonding. We utilized D 2 exposures of 17,400 L on the boron powder, which led to retention on the order of 0.5 g D per 100 kg B or 1.2 g D per m 2 B, as estimated from temperature programmed desorption measurements. We evaluated how powder bakeouts under ultra-high vacuum (UHV), or in an oxygen (O 2 ) or H 2 gas backfilled environment can remove the retained fuel. Bakeouts below 523 K under UHV exhibited poor D removal, promoting recapture of D 2 present as background gas in the chamber. Higher temperature bakeouts led to the removal of over 80% of the retained D within 3 days (623 K) or 1 h (723 K). Bakeouts at 423 K under an O 2 gas environment removed ∼150% more retained D from the boron powder, when compared to bakeouts conducted under UHV. These results suggest that efficient fuel removal from boron dust can be achieved by high-temperature bakeout (>623 K) or by bakeouts at lower temperature (423 K) under an O 2 environment.

Bakeout

CEERP SM3 Research, Monitoring, and Evaluation Workshop: Summary Report

The Columbia Estuary Ecosystem Restoration Program (CEERP) workshop, “CEERP Synthesis Memorandum (SM3): Research, Monitoring, and Evaluation,” was held in Portland, Oregon on June 24–25 2024. A diverse group of 26 domain experts with demonstrated knowledge and experience working in the Lower Columbia River Estuary (LCRE) participated. The workshop supported development of the forthcoming third Synthesis Memorandum for CEERP. The workshop furthered the collaborative understanding of the state of the science regarding the LCRE, helped to identify remaining knowledge gaps and uncertainties, and assisted in the prioritization of future restoration research and monitoring.

54 ENVIRONMENTAL SCIENCES

Evaluation of the Radiological Characterization for Off-Site Source Recovery Program Waste Streams LA-OS-00-01.001, LA-OS-00-03, and LA-OS-00-04

The purpose of this memorandum is to satisfy the requirements of Section 4.4 of the CCP Acceptable Knowledge Documentation procedure CCP-TP-005 (Ref. 1). This evaluation is updating the previously issued memo NEN3:24-045 issued in August 2024. CCP-TP-005 requires an AK Expert and the OSRP group to evaluate the radionuclide characterization of a waste stream and prepare the NDA Memorandum (letter to CCP Records). This NDA memorandum was written with input from the OSRP group, as required by CCP-TP-005. This memo includes a discussion of the limitations for the radiological characterization and a description of the characterization method.

07 ISOTOPE AND RADIATION SOURCES

Root genetics in the field to understand drought adaptation and carbon sequestration (Final Scientific/Technical Report)

For all crop plants, roots play a critical role in growth. Roots anchor the plants, and are the primary site of nutrient and water uptake. Roots are also the main source of C to soil in the form of root tissues and exudates, and thus greatly influence SOM stocks. To perform these functions, primary roots extend into soil, producing a network of branching roots of characteristic form, known as its root system architecture (RSA). RSA varies among species, and among varieties within a species that are adapted to different environments. Root traits are major targets for the second green revolution because of their potential to improve crop productivity, increase drought tolerance and nutrient acquisition, and increase C capture of soil. Improving the quality of roots in maize will be particularly valuable, since this crop is planted on over 92 million acres annually in the US. The future sustainability of agricultural systems relies on their ability to enhance soil organic matter (SOM) storage and reduce GHG emissions, while maintaining or enhancing productivity. This program had two components, Sensors and Models. For the first component, we designed and built a high-throughput phenotyping platform for root pulling of maize plants. This eliminated the physical labor of manually pulling up plants and reduced the number of personnel required down to one. The standardized pulling mechanism allowed recording force curves during the pulling process, providing additional information. We validated that the maximum force for pulling the root system was well-correlated with the root system mass and provided root crowns for further RSA analysis. These root crowns identified significant correlations with 2D root area and root depth, along with 3D root volume, total root length and number of root tips. We then used this system for field-based studies in maize on the genetics of root system architecture and its relation to nitrogen-use efficiency (NUE), including using lines relevant to the Corteva breeding program. Varieties were also evaluated at Corteva sites in the cornbelt and Danforth farm in Missouri, to establish responses across sites. From these studies we have identified genetic loci associated with root traits and created mutant lines for these loci and correlations of root traits with NUE. For the Models component, we worked to incorporate root and soil characteristics into the MEMS 2.0 soil and ecosystem biogeochemical model. Existing soil C models, such as Century, are unable to represent specific root trait interactions with the soil environment and therefore to accurately forecast the potential C sequestration benefits of root breeding under different climatic and soil type conditions. We have developed the MEMS 2.0 ecosystem biogeochemical model to improve quantification of farm-scale soil carbon and greenhouse gas emissions. The new knowledge and large datasets produced by this project will be used to develop and drive an innovative model capable of forecasting the impacts on soil C stocks and nutrient dynamics. An innovation was to use the empirical data from the field studies (in 1, above) to model genetic variation in nitrogen use efficiencies and soil C input. Our work demonstrated that maize root-derived C rapidly replaces existing soil C and after 3 years of continuous maize, up to 20% of soil organic C in the topsoil (0-15cm) and 3% in the subsoil (15-30cm) was contributed by maize. However, this contribution did not entirely represent a net increase. Root C contribution to soil was affected by maize genetics. We have analyzed soils derived from the CSU field trials for C and N stocks, in the different soil physical fractions represented by the MEMS model, using both physical fractionation with elemental analyses, and Fourier transformed infrared spectroscopy. Data will be used to link crop nitrogen use efficiencies with soil C sequestration and provide data to bridge the field trials with the model development, for verification of model predictions. The project had a number of successful outcomes: we have used the new phenotyping platform to identify new genetic loci that can enhance root phenotypes; we have partnered with multiple maize seed companies phenotype varieties in their breeding programs; we have developed the MEMS model that can help inform industry on the potential for carbon sequestration in the agricultural sector, and which is now available at the CSU Soil Carbon Solutions Center for use.

59 BASIC BIOLOGICAL SCIENCES

Evaluating technology upgrades as a complement to traditional bill assistance programs

State programs to improve energy affordability and reduce energy burden (the share of income spent on energy) could mitigate concerns about rising electricity prices. Many states offer bill assistance and rebates for weatherization and rooftop solar to income-qualifying households. Here, we analyse how these approaches may complement one another to improve energy affordability. Results illustrate trade offs between program costs and energy burden reduction, as well as between a program’s upfront and ongoing costs. Generally, the three strategies complement one another to improve energy affordability at lower net present cost than bill assistance alone, with varying effects across regions. Weatherization can reduce the solar installation capacity needed, and both together can reduce or eliminate ongoing reliance on bill assistance. Under full uptake among cost-effective households, fully rebated weatherization and solar rebated at $0.48/Watt, combined with bill assistance, yield the same modelled net present cost as bill assistance alone while reducing the share of low-income owner-occupied households with high energy burdens from 66% to 19%, compared with 34% under bill assistance alone. Absent tax credits, weatherization still reduces energy burden and bill assistance program costs, whereas solar may not be cost-competitive.

Forrester, Sydney P