Search NASA⌕ Search

SEARCH · Search NASA

Results for “Program Evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Multi-Semester Mentoring and GPA Trajectories in SPINS: A Longitudinal Program Evaluation of STEM Scholars

This exploratory longitudinal program evaluation examined GPA trajectories among 14 STEM scholars participating in the Scholarly Partnership in Nuclear Security (SPINS) mentoring program at an HBCU. Using de-identified administrative data (37 scholar-semester observations), the study compared baseline and latest term GPAs anchored to each scholar’s first funded semester. A Wilcoxon signed-rank test was used to assess within-student change. Mean GPA increased modestly from 3.46 (SD = 0.30) at baseline to 3.61 (SD = 0.33) at the latest observed semester, with 12 of 14 scholars (85.7%) showing net improvement (median change = +0.12). The Wilcoxon signed-rank test indicated a statistically significant positive shift (W = 18, p = 0.030). However, scholars entered the program with a high baseline GPA, and ceiling effects were evident for several participants. Grounded in Social Cognitive Career Theory, findings suggest that multi-semester participation in SPINS is associated with GPA stability and modest improvement in an already high-performing cohort. Results should be interpreted cautiously given the small sample size and single-group design. The study highlights the value of sustained, culturally responsive mentoring at an HBCU while underscoring the need for larger evaluations with comparison cohorts and broader psychosocial outcomes. An evidence-informed mentoring framework is proposed to strengthen multi-semester support.

42 ENGINEERING↗
DOE OSTI2021

Money Matters: A Three-Step Process for Using Budget Data in Program Evaluation to Assess the Design and Management of a Novel Public Health Program

We applied a three-step process, abstracting and analyzing program budgets to examine how Colorectal Cancer Control Program (CRCCP) awardees are structuring their programs and to assess the fidelity of program design to the CRCCP public health model. We reviewed 23 state, one tribal organization, and six university awardee budgets. We assessed resource allocations, staffing structures, and contracted partners and their activities. Awardees allocated 83% of all funds to contracts and personnel. Program managers were the most budgeted personnel type across three measures: number of people, full-time equivalency, and personnel costs. Awardees not only contracted with health care systems and clinics (39% of all contracts) but also contracted other partner types. Contractors were mainly funded to implement evidence-based interventions (25%) and conduct evaluation (24%). Program design varied among awardees in the number of staff (0–22), number of full-time equivalencies (0–5.4), and the number of contracts (1–11) budgeted. State awardees budgeted more resources to contracts, compared with university awardees (57% vs. 31%), while universities budgeted more for total personnel costs (41% vs. 30%). We learned that awardees designed their programs with fidelity to the CRCCP model. Although implementation approaches varied, overall results suggest implementation requires a combination of internal capacities and contracted partners. Budgets provide opportunities to use already existing program data to evaluate program design, partnerships, and planned activities.

Uhd, Justin↗
DOE OSTI2023

ES4SE Technical Assistance Program Evaluation

Technical assistance (TA) programs can provide organizations and communities with the information, tools, and resources needed to support their development and resilience goals. The Energy Storage for Social Equity (ES4SE) TA program sought to empower undeserved communities through co-development of energy storage pathways and solutions to address community-defined challenges and needs. Evaluating the design, implementation, and outcomes of TA programs like ES4SE is critical to understanding whether program and participant goals were accomplished and how to adjust the TA approach to better meet participant needs. This evaluation explores the experiences and perceptions of community participants in the ES4SE TA program.

25 ENERGY STORAGE↗
DOE OSTI2022

Launch Accident Sequence Evaluation Program

SAND2024-09978O The Launch Accident Sequence Evaluation Program is used to calculate the source term for the consequence analysis involving a launch vehicle accident with a space nuclear system. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Kalinich, Donald↗
DOE OSTI2020

Metaevaluation Final Report: Sandia National Laboratories Recorded Information Management Training Program Evaluation

For my internship project, I chose to evaluate the training program for the Sandia National Laboratories (SNL) Recorded Information Management (RIM) Program. The purpose of the evaluation was to identify: Where the current training meets federal and corporate requirements and if not, what gaps exist; If the training is accessible in a consistent location; If the training contains a consistent message about the responsibility of managing documents; If the training is organized by records management subject areas.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2021

L-Basin Microbial Monitoring Program - Evaluation of 20 Years of Monitoring

The SRNL L-Basin corrosion surveillance and microbial monitoring programs provide early detection and characterization of corrosion attack to the fuel and storage system materials resulting from prolonged exposure to the L-Basin water environment and of changes to and impact of the diverse microbial population, respectively. The early detection of corrosion allows for adjustment of the water quality, engineering management, and fuel storage configurations to mitigate excessive corrosion attack. While microbial influenced corrosion in L-Basin has not been detected, tracking and understanding the effect of microbial populations on the stored fuel and basin water will aid in identifying remedial measures to mitigate any detrimental impact. This report reviews the microbial monitoring activities since initial characterizations in the mid-1990s.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2021

L-Basin microbial monitoring program - evaluation of 20 years of monitoring

This report summarizes the results from over 20-years’ of activities for microbial monitoring of the bulk water, floc analysis, and test coupon surfaces for the Savannah River Site L Basin. The Microbial Monitoring Program provides important information for the characterization of overall water quality as it impacts the continued safe storage of spent nuclear fuel in L Basin. The potential impacts to fuel storage are: 1) microbial-influenced corrosion of the fuel; and 2) biofouling of the fuel storage systems.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2019

Systematic Technology Evaluation Program for SiC-based BWR Channel Box

Silicon carbide (SiC) –based accident-tolerant fuel (ATF) cladding of light water reactors (LWRs) has become a topic of great interest in nuclear material development since the Fukushima Dai-ichi Nuclear Power Plant accident. Extensive development of SiC cladding has identified benefits of the concept, including its inherent accident resistance and neutronic performance. Advancements achieved during the development of SiC-based ATF cladding have made it attractive for use in accident-tolerant cores of LWRs. In this document, we consider the use of SiC-based materials to replace the zirconium alloy used for the channel boxes of boiling water reactors. Both accident resistance and prevention of the bowing observed in current grades of channel boxes are needs driving the exploration of a new channel box system. To provide a pathway for channel box development, this document lays out (1) a current technology overview, (2) the technology gap, and (3) a systematic technology evaluation plan. The objectives of the technology evaluation plan are to address key feasibility issues revealed by the knowledge gap analysis and to contribute to advancing the technology readiness level. Further development will be required in the technology implementation phase. The technology evaluations include understanding the behavior of channel boxes under both normal and off-normal conditions, identifying potential mitigation strategies for the issues if necessary, and improving channel box performance based on the knowledge obtained. The structure of the technology evaluation plan and each task are shown in Figure S.1. The knowledge gap analysis identified key research areas, including irradiation effects, hydrothermal corrosion, accident behavior, and design and manufacture. These are common issues between SiC-based channel boxes and SiC-based fuel cladding, although technical evaluations specific for the channel box components are required. This document also describes details of the technical feasibility evaluation methods and plans.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

APPLICATION OF MATURITY MODELS FOR EVALUATING CYBERSECURITY PROGRAMS AT NUCLEAR AND RADIOLOGICAL FACILITIES

Maturity models can be used to provide government agencies, industry associations, and organizations operating nuclear facilities with the ability to quickly evaluate the maturity of their cybersecurity programs and identify areas to prioritize for improvement. The Cybersecurity Capability Maturity Model (C2M2) was developed by the U.S. Department of Energy to allow organizations in the energy sector to evaluate the programmatic capabilities of their cybersecurity programs in a consistent manner, communicate programmatic maturity information, prioritize cybersecurity investments in targeted areas of concern, and track how the maturity of their cybersecurity program evolves over time. The C2M2 is designed for use by any critical infrastructure organization regardless of ownership, structure, or size. The C2M2 can be easily fine-tuned to access the maturity of nuclear cybersecurity programs and their application at individual facilities. Built on a foundation of existing cybersecurity standards, frameworks, programs, and initiatives, the model features 10 security domains. Performance in each security domain is characterized using a structured set of cybersecurity practices that represent activities an organization can perform to improve cybersecurity in their domain. Each practice can be quickly evaluated as being either fully, largely, partially, or not implemented. Once practices are evaluated for each security domain, the model defines four maturity indicator levels that apply independently to each domain in the model. To earn a maturity level in a given domain, an organization must adequately perform all the practices for that maturity level and its predecessor level(s). A small assessment team can conduct a C2M2 assessment in a single day. A screening version of the C2M2 allows an initial look at the maturity of nuclear cybersecurity programs that could be completed in under an hour.

Cyber security, Nuclear security, maturity model↗
DOE OSTI2018

4th Quarter and Annual Transportation Report FY2018

This report satisfies the U.S. Department of Energy, National Nuclear Security Administration Nevada Field Office (NNSA/NFO) commitment to prepare a quarterly summary of waste shipments to the Nevada National Security Site (NNSS) Radioactive Waste Management Complex (RWMC) in Area 5. This report summarizes the fourth quarter of fiscal year (FY) 2018 and serves as an annual report for the following types of shipments: Low-Level Radioactive Waste (LLW); Mixed Low-Level Radioactive Waste (MLLW); Classified Non-Radioactive (CNR) Waste; Classified Non-Radioactive Hazardous (CNRH) Waste; Tabular summaries are provided that include the following: Number and external volume of LLW, MLLW, and CNR/CNRH shipments; Waste generators for LLW, MLLW, and CNR/CNRH shipments to and on the NNSS; Carriers for LLW, MLLW, and CNR/CNRH shipments to and on the NNSS; Waste generator shipments by quarter; Highway routes used by carriers; Incident and accident data applicable to LLW, MLLW, and CNR/CNRH shipments. In this report, shipments are accounted for upon arrival at the NNSS, while disposal volumes are accounted for upon waste burial. Volume reports showing cubic feet (ft 3 ) generated using the Low-Level Waste Information System may vary slightly due to rounding conventions for conversions from cubic meters to cubic feet. Shipments are transported by motor carriers that are either identified on the U.S. Department of Energy (DOE) Motor Carrier Evaluation Program (MCEP) list, have been evaluated in a manner similar to the MCEP process, or are government vehicles. Government vehicles are not evaluated using the MCEP process but are fully compliant with all transportation regulations and requirements.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Initial Delayed Critical Configuration of SHEBA I and Subcritical Measurements by Californium Source-Driven Noise Analysis

In September 1980, the initial delayed critical configuration of the Solution High-Energy Burst Assembly (SHEBA I) was assembled, and the US Department of Energy’s Oak Ridge National Laboratory (ORNL) staff performed near critical and subcritical measurements using the californium source-driven noise analysis (CSDNA) method at the Los Alamos National Laboratory (LANL) Critical Experiments Facility. An unreflected 56 cm outside diameter stainless-steel cylindrical tank was partially filled with uranyl fluoride solution (235U enrichment was 4.95 wt %) until delayed criticality was achieved. Then, measurements were performed for various fuel solution heights from delayed critical to 60% of the height required for delayed criticality. The stainless-steel tank had an inside diameter of 54.6 cm and a height of 105 cm and was partially (20–36.5 cm) filled with an aqueous solution of uranyl fluoride (with a density of 2.162 g/cm 3 ). The density of the uranium in solution was 1.042 g/cm 3 , and the solution had a H/U atomic ratio of 20.43. The tank had a 6.35 mm wall thickness and an axial reentrant tube with an inside diameter of 6.02 cm and wall thickness of 0.165 cm. The tank was essentially unreflected on the top and sides because it was in a thin metal shed. The reactivity of the near–delayed critical configuration was −10.4 cents, which corresponds to a k eff value of 0.99922. In addition to the CSDNA measurements, the prompt neutron decay constants were determined from break frequency noise analysis (BNFA) measurements. The subcritical neutron multiplication factors from CSDNA and BFNA compared extremely well. These data can be used as the basis of International Nuclear Criticality Safety Evaluation benchmark for the near-critical configuration, and the k eff values at various subcritical configurations can be used as subcritical benchmarks. Furthermore, the measured prompt neutron decay constants can be used as reactor physics benchmarks. This report documents the experimental information for the measurements performed so that, at a later date, researchers could perform the required uncertainty and calculational analyses and documentation to use these data for an International Criticality Safety Benchmark Evaluation Program (ICSBEP) or Nuclear Energy Agency benchmarks. The measured prompt neutron decay constants can be used as the basis of a benchmark for the International Reactor Physics Evaluation Program (IRPhEP). The data from these measurements are available from the ORNL Records Management Services Department, and the logbook is available from ICSBEP at Idaho National Laboratory.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Delayed Critical Enriched Uranium Metal, 7-in.-diam. Cylinder with Thin Stainless Steel Top and Bottom Reflectors

Three 7 in. diameter highly enriched uranium (HEU; 93.17 wt % 235 U) metal cylinders were assembled on the vertical assembly machine of the Oak Ridge Critical Experiments Facility (ORCEF) with thin stainless steel reflectors (0.5, 1, and 2 in. thick) on the top and bottom. These experiments were performed during January 13–25, 1965, and used seven operational days at ORCEF. Before these experiments, unreflected and unmoderated 7 in. diameter HEU metal cylinders had been assembled to delayed criticality at ORCEF, and the results were benchmarked in HEU-MET-FAST-051. In addition to the critical experiments, the prompt neutron decay constant was measured via the Rossi-α technique, and those results are also presented in this report. To achieve near-delayed-critical systems, 5 × 5 × 0.03125 in. rectangular uranium metal parts were used on top of 7 in. diameter cylinders inside the top reflector. The delayed critical configuration from the three experiments described herein are acceptable for use as criticality safety benchmark experiments for the International Criticality Safety Benchmark Evaluation Program (ICSBEP), coordinated by the Nuclear Energy Agency, once the uncertainty analysis is completed. Based on previous ICSBEP benchmarks with this enriched uranium metal at ORCEF, the uncertainty in $k_{eff}$ is expected to be as low as ±0.0002. The prompt neutron time decay data could be the basis of an International Reactor Physics Evaluation Program benchmark.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Evaluation of Programming Language-Aware Diffs for Improving Developer Productivity

As the number of supported platforms for SNL software increases, so do the testing requirements. This increases the total time spent between when a developer submits code for testing, and when tests are completed. This in turn leads developers to hold off submitting code for testing, meaning that when code is ready for testing there's a lot more of it. This increases the likelihood of merge conflicts which the developer must resolve by hand -- because someone else touched the files near the lines the developer touched. Current text-based diff tools often have trouble resolving conflicts in these cases. Work in Europe and Japan has demonstrated that, using programming language aware diff tools (e.g., using the abstract syntax tree (AST) a compiler might generate) can reduce the manual labor necessary to resolve merge conflicts. These techniques can detect code blocks which have moved, as opposed than current text-based diff tools, which only detect insertions / deletions of text blocks. In this study, we evaluate one such tool, GumTree, and see how effective it is as a replacement for traditional text-based diff approaches.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

State Technical Assistance - New Mexico Energy and Conservation Management Division Report [Slides]

The New Mexico Energy and Conservation Management Division (ECMD) sought technical assistance to enhance their ability to evaluate program impacts using the Low-Income Energy Affordability Data (LEAD) tool. NLR assisted ECMD in leveraging the LEAD tool to calculate and analyze energy burden across electric utility service areas, enabling them to assess program outcomes more effectively. To meet ECMD's goals, NLR developed a customized methodology to calculate utility-specific energy burden metrics using census tract data and available utility service area information from the Energy Information Administration (EIA). While acknowledging some limitations in the EIA dataset, NLR estimated the percentage of households within each service territory and incorporated relevant filters such as income, housing characteristics, and other demographics from the LEAD tool. The analysis provided ECMD with a new capability to evaluate program success based on energy savings, reductions in energy burden, and other performance indicators. The data and methodology also support discussions with utilities to improve the accuracy of service territory datasets. ECMD can use the outputs to track program effectiveness and plan future initiatives. NLR offered the possibility of follow-on work, including capacity-building for ECMD to repeat the analysis independently and the option to refine the analysis with updated service.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Strategic Energy Management Program Persistence and Cost Effectiveness An Analysis of the SEM Program Landscape

This study examines the relationship between strategic energy management (SEM) programs and their persistence and cost effectiveness, with analysis based on interview data from 24 SEM program administrators, SEM program evaluations, and other reports. The 80 interview questions focused on the topics of program design, energy savings, energy savings persistence, cost effectiveness, and customer SEM persistence. The generosity of interview respondents provided a wealth of data, resulting in a report of sufficient length to warrant inclusion of this brief guide of the report structure. The major sections are listed below with brief descriptions. Individual sections of this report are mainly stand-alone and do not require reading of other sections. As a result, there is some duplication between sections, but with differing levels of detail. Executive Summary: Presents three key conclusions of this work with a short description of potential actions to advance the understanding of each key finding. Brief Observations: Lists a large number of bulleted observations resulting from this research, arranged by the five major topic areas included in the interviews. Analysis details are provided in the Analysis of Interview Results section. Foundations for this Research: Provides an overview of SEM, SEM frameworks, SEM programs, the topics of persistence and cost effectiveness, and the focus of this research. Methodology: Details the approach and strategy of this research, providing background information relevant to the formulation of interview questions and the identification of which SEM programs to interview. Observations from Compiled Evaluations and Other Reports: Reports observations from the collection and analysis of program evaluations, annual reports, utility planning documents, and SEM-related white papers. This section, presented in bullet form, highlights challenges in data collection and ultimately a comparison of program practices as they pertain to persistence and cost effectiveness. Analysis of Interview Results: Presents detailed analysis of responses from SEM program administrators, arranged by the five major categories examined: program design, energy savings, energy savings persistence, cost effectiveness, and customer SEM persistence. Interview questions are generally grouped together into subsections when it makes sense to examine them together. SEM Programs Challenge Traditional Cost-Effectiveness Metrics: Details an analysis based on five key factors showing that applying traditional cost-effectiveness metrics to SEM programs is not straightforward. This invites the opportunity to consider whether traditional cost-effectiveness metrics are applicable to SEM programs, either individually or at large. Resolution of Research Hypotheses: Tabulates a set of hypotheses that were developed to address the fundamental nature of the research at hand. Analysis of responses to multiple questions informs an understanding of each hypothesis and can be used to better understand the SEM program environment at large.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗