Search NASA⌕ Search

SEARCH · Search NASA

Results for “program evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Multi-Semester Mentoring and GPA Trajectories in SPINS: A Longitudinal Program Evaluation of STEM Scholars

This exploratory longitudinal program evaluation examined GPA trajectories among 14 STEM scholars participating in the Scholarly Partnership in Nuclear Security (SPINS) mentoring program at an HBCU. Using de-identified administrative data (37 scholar-semester observations), the study compared baseline and latest term GPAs anchored to each scholar’s first funded semester. A Wilcoxon signed-rank test was used to assess within-student change. Mean GPA increased modestly from 3.46 (SD = 0.30) at baseline to 3.61 (SD = 0.33) at the latest observed semester, with 12 of 14 scholars (85.7%) showing net improvement (median change = +0.12). The Wilcoxon signed-rank test indicated a statistically significant positive shift (W = 18, p = 0.030). However, scholars entered the program with a high baseline GPA, and ceiling effects were evident for several participants. Grounded in Social Cognitive Career Theory, findings suggest that multi-semester participation in SPINS is associated with GPA stability and modest improvement in an already high-performing cohort. Results should be interpreted cautiously given the small sample size and single-group design. The study highlights the value of sustained, culturally responsive mentoring at an HBCU while underscoring the need for larger evaluations with comparison cohorts and broader psychosocial outcomes. An evidence-informed mentoring framework is proposed to strengthen multi-semester support.

42 ENGINEERING↗
DOE OSTI2023

ES4SE Technical Assistance Program Evaluation

Technical assistance (TA) programs can provide organizations and communities with the information, tools, and resources needed to support their development and resilience goals. The Energy Storage for Social Equity (ES4SE) TA program sought to empower undeserved communities through co-development of energy storage pathways and solutions to address community-defined challenges and needs. Evaluating the design, implementation, and outcomes of TA programs like ES4SE is critical to understanding whether program and participant goals were accomplished and how to adjust the TA approach to better meet participant needs. This evaluation explores the experiences and perceptions of community participants in the ES4SE TA program.

25 ENERGY STORAGE↗
DOE OSTI2023

Initial Delayed Critical Configuration of SHEBA I and Subcritical Measurements by Californium Source-Driven Noise Analysis

In September 1980, the initial delayed critical configuration of the Solution High-Energy Burst Assembly (SHEBA I) was assembled, and the US Department of Energy’s Oak Ridge National Laboratory (ORNL) staff performed near critical and subcritical measurements using the californium source-driven noise analysis (CSDNA) method at the Los Alamos National Laboratory (LANL) Critical Experiments Facility. An unreflected 56 cm outside diameter stainless-steel cylindrical tank was partially filled with uranyl fluoride solution (235U enrichment was 4.95 wt %) until delayed criticality was achieved. Then, measurements were performed for various fuel solution heights from delayed critical to 60% of the height required for delayed criticality. The stainless-steel tank had an inside diameter of 54.6 cm and a height of 105 cm and was partially (20–36.5 cm) filled with an aqueous solution of uranyl fluoride (with a density of 2.162 g/cm 3 ). The density of the uranium in solution was 1.042 g/cm 3 , and the solution had a H/U atomic ratio of 20.43. The tank had a 6.35 mm wall thickness and an axial reentrant tube with an inside diameter of 6.02 cm and wall thickness of 0.165 cm. The tank was essentially unreflected on the top and sides because it was in a thin metal shed. The reactivity of the near–delayed critical configuration was −10.4 cents, which corresponds to a k eff value of 0.99922. In addition to the CSDNA measurements, the prompt neutron decay constants were determined from break frequency noise analysis (BNFA) measurements. The subcritical neutron multiplication factors from CSDNA and BFNA compared extremely well. These data can be used as the basis of International Nuclear Criticality Safety Evaluation benchmark for the near-critical configuration, and the k eff values at various subcritical configurations can be used as subcritical benchmarks. Furthermore, the measured prompt neutron decay constants can be used as reactor physics benchmarks. This report documents the experimental information for the measurements performed so that, at a later date, researchers could perform the required uncertainty and calculational analyses and documentation to use these data for an International Criticality Safety Benchmark Evaluation Program (ICSBEP) or Nuclear Energy Agency benchmarks. The measured prompt neutron decay constants can be used as the basis of a benchmark for the International Reactor Physics Evaluation Program (IRPhEP). The data from these measurements are available from the ORNL Records Management Services Department, and the logbook is available from ICSBEP at Idaho National Laboratory.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

State Technical Assistance - New Mexico Energy and Conservation Management Division Report [Slides]

The New Mexico Energy and Conservation Management Division (ECMD) sought technical assistance to enhance their ability to evaluate program impacts using the Low-Income Energy Affordability Data (LEAD) tool. NLR assisted ECMD in leveraging the LEAD tool to calculate and analyze energy burden across electric utility service areas, enabling them to assess program outcomes more effectively. To meet ECMD's goals, NLR developed a customized methodology to calculate utility-specific energy burden metrics using census tract data and available utility service area information from the Energy Information Administration (EIA). While acknowledging some limitations in the EIA dataset, NLR estimated the percentage of households within each service territory and incorporated relevant filters such as income, housing characteristics, and other demographics from the LEAD tool. The analysis provided ECMD with a new capability to evaluate program success based on energy savings, reductions in energy burden, and other performance indicators. The data and methodology also support discussions with utilities to improve the accuracy of service territory datasets. ECMD can use the outputs to track program effectiveness and plan future initiatives. NLR offered the possibility of follow-on work, including capacity-building for ECMD to repeat the analysis independently and the option to refine the analysis with updated service.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Zero-Emission Transit Bus Needs Assessment

The transition to zero-emissions vehicles (ZEVs) in public transit has gained traction due to significant federal investments from the Bipartisan Infrastructure Law (BIL) and the Inflation Reduction Act (IRA). This needs assessment, commissioned by the Joint Office of Energy and Transportation and conducted by researchers at the Idaho National Laboratory, explores the current state of electrification in transit agencies, identifying barriers to implementation, potential funding sources, and operational considerations necessary for a successful transition. The assessment involved qualitative interviews with representatives from 19 transit service providers across diverse geographic regions. Key findings highlight the challenges related to bus facilities and operations, which require careful planning for charging infrastructure and maintenance capabilities to accommodate battery electric buses (BEBs) and hydrogen fuel cell buses (HFCBs). Agencies reported operational hurdles due to the shorter range of BEBs compared to diesel buses, necessitating revised scheduling and routing strategies. Despite these challenges, many agencies expressed optimism about their capacity to adapt. Funding availability emerged as a critical factor influencing the transition to ZEVs. While agencies welcomed increased financial support, particularly from the Low or No Emission Grant Program (Lo-No), concerns about the sustainability of this funding and the ongoing operational costs were prevalent. The need for a comprehensive funding inventory was underscored to ensure transit agencies are aware of all available resources. Technological constraints were significant barriers to ZEV adoption. The limited range of BEBs was frequently cited as a concern, leading to operational challenges and reliability issues. Agencies reported difficulties in sourcing replacement parts, which exacerbated downtime and maintenance challenges. Workforce development and training were identified as pivotal for a successful transition. Many agencies rely heavily on manufacturers for technician training, highlighting the need for scalable training programs that equip staff with the necessary skills to maintain electric powertrains effectively. This assessment offers actionable recommendations for the Joint Office, including enhancing outreach to transit agencies, developing resources for effective utility partnerships, and facilitating comprehensive training programs. Establishing a zero-emission bus evaluation program to track performance metrics such as cost, range, and reliability could provide valuable insights for transit agencies. The needs assessment provides a detailed examination of the challenges and opportunities facing transit agencies in their transition to zero-emissions bus fleets. By addressing these issues through targeted support, stakeholders can collaboratively work towards a cleaner, more sustainable public transportation system that benefits all communities.

33 - ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

Understanding Emerging Building Technologies in Federal Performance Contracting Markets

Every year, federal technology evaluation programs test and assess the performance of building technologies that are being considered for wider deployment in federal facilities. Despite these investments in technology validation, many of the technologies evaluated by federal programs struggle to achieve broad penetration into the federal performance contracting market. This report contains the results of a market-research survey conducted by the National Renewable Energy Laboratory to understand barriers to the wider adoption of validated building technologies in the federal performance contracting market and how this information can be used to increase their deployment. The initial phase of this research focuses on the energy service company community and the barriers they perceive to wider adoption of these evaluated technologies. The report ends with an examination of recommendations for how the U.S. Department of Energy's Federal Energy Management Program can assist agencies in deploying emerging building technologies through energy savings performance contracts.

25 ENERGY STORAGE↗
DOE OSTI2023

Workforce Program Design and Evaluation [Slides]

This is a presentation for a Better Buildings Workforce Accelerator workshop on workforce program design and evaluation. The presentation includes content and tools to help in crafting program or course goals and objectives (and the difference between the two), and on selecting appropriate evaluation metrics based on the goals and desired outcomes of the program.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Improving Efficiency of Off-Road Vehicles by Novel Integration of Electric Machines and Advanced Combustion Engines

Modern off-road equipment will increasingly rely on electrified implements that will deliver precision control with a smaller footprint than hydraulics. The primary energy converter, however, will be an onboard reciprocating internal combustion engine because of the power density of hydrocarbon fuels in comparison to electrical energy storage and the remote locations where much of this equipment is deployed. Adding energy storage and electric machines creates opportunities to improve efficiency while reducing emissions. This program investigated approaches to take advantage of the extra flexibility that an enhanced electrical system to enable high-efficiency, low-emissions combustion technologies. The current program evaluated hybridization of both the torque application and air-handling systems to maximize efficiency while minimizing cost. This program designed, analyzed and tested a hybrid off-road vehicle consisting of a series electric powertrain with energy storage, an electrified air system, and a 33% downsized diesel engine. Detailed comparisons were made between the base powertrain and the developed powertrain using powertrain simulations, engine testing, and vehicle testing. The key results of the study are: • The resulting vehicle reduces fuel consumption by 5% to 15% at equal productivity. The primary improvements were due to recovery of regenerative braking losses for cycles where large transients are encountered. • The electrified air system was an enabler to allow engine downsizing. This was most important for duty-cycles where the engine primarily operated at moderate loads and had few low speed high torque conditions. • Engine level improvements showed re-optimization of the powertrain is possible when electrified air handing is available. Increased exhaust gas recirculation and advanced injection timing allowed up to a 15% reduction in brake specific fuel consumption at equal NOx and transient response. Compared to the larger engine, the downsized engine achieves up to an 18% reduction in brake specific fuel consumption over the non-road transient cycle. • The life cycle analysis and total cost of ownership study showed that the hybrid powertrain has the potential to reduce 5-year CO2 and total cost of ownership by ~6% over the baseline vehicle. The results also indicated that a pure battery electric vehicle is not feasible in this application and is likely to increase the CO2 emissions due to the CO2 from battery production. A hybrid powertrain with low carbon fuels shows the potential to substantially reduce CO2 and total cost of ownership.

02 PETROLEUM↗
DOE OSTI2025

Assessing the cumulative effects of nearshore habitat restoration actions for multiple populations of juvenile salmon in Whidbey Basin, Washington: foundation and approach for synthesis and evaluation

Ecosystem restoration is a common tool for re-establishing ecosystem processes, structures, and functions to improve biodiversity and services in coastal and estuarine ecosystems. In the Salish Sea, salmon habitats have been fragmented, reduced in size, and diminished in quality, and the ecosystem processes that form and sustain these habitats have been degraded and disrupted as well. This loss is especially prevalent in estuaries, where up to 90% of former salmon habitat has been lost or compromised. Salmon species are integral to the identities and cultures of people in the Pacific Northwest, yet salmon abundances remain at historic lows, especially in urbanized areas. Recent investments in restoration are creating rearing habitat and repairing lost ecosystem function. However, restoration efforts in this region have largely proceeded at the site scale, with less attention to big-picture thinking regarding how restoration will effectively recover degraded or lost habitats for target species. As a result, no landscape-scale evaluation program exists, and the cumulative benefits of multiple interventions are unknown. We describe innovative methods for science synthesis related to the evaluation of cumulative effects of ecosystem restoration for Pacific salmon, using years of existing, but disparate data. Building from previous work on cumulative effects evaluation and incorporating a hierarchy of hypotheses approach, we propose using causal inference across numerous hypotheses in a framework to assess the cumulative benefits to Pacific salmon from multiple estuarine restoration projects. We present the framework as a method that can be used to address many complex questions and provide examples from the Salish Sea where the approach is being implemented. The framework draws on science synthesis from numerous fields and uses a hierarchy of hypotheses, causal analysis at multiple scales, and a new hierarchy of synthesis for assessing multiple lines of evidence documenting restoration effects on Pacific salmon. We propose causal inference to synthesize dissimilar data streams, in our case, to identify various manifestations of cumulative effects of restoration and benefits to salmon, and to further inform restoration and recovery planning. A unifying framework would allow for the detection of thresholds at which restoration provides measurable improvement and would greatly advance understanding of the effects of restoration on ecosystems.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

ALGEBRA v.1.27

The ALGEBRA program allows the user to manipulate data from a finite element analysis before it is plotted. The finite element output data is in the form of variable values (e.g., stress, strain, and velocity components) in an EXODUS II database. The ALGEBRA program evaluates user-supplied functions of the data and writes the results to an output EXODUS II database that can be read by plot programs.

Sjaardema, Gregory↗
DOE OSTI2024

M3SF-24LL010302062-NEA-TDB Management and International Collaborations in Sorption and Thermodynamic Modeling

This progress report (Level 3 Milestone Number M3SF-24LL010302062) summarizes research conducted at Lawrence Livermore National Laboratory (LLNL) within the Crystalline International Collaborations Work Package Number SF-24LL01030206. The activity is focused on our long-term commitment to engaging our partners in international nuclear waste repository research. This includes participation in the Nuclear Energy Agency Thermochemical Database (NEA-TDB) Project and development of methodologies for integrating US and international thermodynamic databases for use in SFWST Generic Disposal System Assessment (GDSA) efforts. A continuing focus for FY24 efforts is to support the US participation in the NEA-TDB effort. The focus of FY24 activities was the development of an agreement for a Phase 7 activity that will start in Q1 of 2025. Mavrik Zavarin is now the US representative on both the Management Board and the Executive group to the NEA-TDB. He is also the POC for the Cements State of the Art Report that is undergoing peer review in FY24. In FY24, we used our position on the NEA-TDB MB and EG to facilitate the integration of NEA-TDB thermochemical data with LLNL’s SUPCRTNE thermodynamic database that supports the SFWST GDSA activities. This effort is coordinated with the Argillite work package SUPCRTNE database development efforts (Wolery, 2024). The goal is to provide a downloadable database that will be hosted on LLNL’s thermodynamics website which incorporates NEA-TDB data into the LLNL database where appropriate. We also began engagement with the EURAD2 program that was initiated in FY24 by our European collaborators at the Karlsruhe Institute of Technology (KIT), Germany. The primary focus of the engagement is with WP20: DITUSC Thermodynamic database evaluation program. A kickoff meeting for this activity is planned for early FY25. Finally, we have been selected to co-host (with Clemson University) the International Conference on Chemistry and Migration Behaviour of Actinides and Fission Products in the Geosphere in 2025 (Migration2025). The meeting will be held September 21-26, 2025, in New Orleans, Louisiana, and will focus on international efforts to understand the risks of radionuclide releases into the environment. This central focus of this conference is on international efforts to develop safe disposal options for nuclear wastes. As such, we are developing a theme focused on US underground nuclear waste repository science.

58 GEOSCIENCES↗
DOE OSTI2026

Farm Practice Typologies as a Strategy for Management-Relevant Land Use and Land Cover Mapping in the Great Lakes Region (Version 1) [Dataset]

Dataset overview and development This dataset provides spatially explicit agricultural land-use and land-management typologies developed for the Great Lakes Region (GLR) at the farm-parcel level. The typologies were designed to characterize not only the land-use and land-cover (LULC) associated with individual agricultural farm parcels, but also the land-management practices (LMPs), including irrigation, tile drainage, and conservation easements, occurring within those parcels and how these characteristics change through time. The dataset contains four related typology products: Annual integrated typology – describes the combined LULC and land-management characteristics for each farm parcel for individual years. LULC transition typology – describes the temporal pattern of LULC change for each farm parcel across the study period (2008-2023). LMP trend typology – describes the temporal pattern in the occurrence of LMPs for each farm parcel across the study period. Multi-year integrated typology – combines the LULC transition typology and LMP trend typology to provide an integrated characterization of long-term land-use and management patterns. Purpose of the dataset The purpose of these products is to provide a management-relevant integrated and consistent framework for evaluating the spatial and temporal organization of agricultural landscapes across the GLR. The resulting typologies can: support landscape-scale environmental and land-use analysis; provide spatial information relevant to land-management strategies, conservation planning, policy development, and program evaluation; characterize spatial patterns of agricultural land use and management; examine changes in agricultural landscapes through time; and identify persistent, transitional, and changing agricultural systems. Please refer to the README file provided in Files for more details.

Agriculture↗
DOE OSTI2024

ASME Design Code Rule Changes for Nuclear Graphite

The American Society of Mechanical Engineers Boiler Pressure and Vessel Code (ASME BPVC) Section III, Division 5, Article HHA-3000 outlines graphite core component and graphite core assembly design guidelines. Graphite core components are defined as ?components manufactured from graphite that are installed to form a graphite core assembly within the reactor pressure vessel of a high temperature, graphite moderated fission reactor.? (p. 413) Graphites? inherent defect distributions do not allow for deterministic material reliability. Rather, graphite has variable strength distributions which change by grade. Article HHA-3000 outlines two semi-probabilistic methods, the full and simplified assessments, which set design load limit targets for each of three component structural reliability classes. The Design Task Group was officially recognized as a specialized task group within ASME November of 2023, though we?ve been collaborating since 2022. The purpose of the Design Task Group is to correct, clarify, and make HHA-3000 function as intended. The Design Task Group will sunset once we?ve achieved our objectives. The Design Task Group was specifically told to not write new Code. While there may be more precise and more accurate methods to determine reliability targets, the current methods are conservative, relatively simple to implement, and have thus far been considered satisfactory for setting design reliability targets. Much of the ground-work to write proposal files and background documents for records to make the changes needed to achieve our objective have been completed. The Design Task Group has documented much of their work through papers, presentations, and memorandums. Three memorandums in which INL team members had substantial contributions are found in the Appendices: FEA Modeling for the Baseline Program, Evaluating the Effects on Margin of Updating the Threshold and Shape Parameters in the Full Assessment, and Interpretations of the Full and Simplified Assessments in ASME BPVC. Most of the on-going work to achieve the Design Task Group?s objective will be addressing comments on existing records and moving records through the balloting process. The Design Task Group met bi-weekly mostly through the end of FY2023. Since February 2024, the Design Task Group has mostly been completed with solving and documenting the technical issues associated with the assessments. Unless new tasks are identified, the remaining work of the Design Task Group will be political and editorial.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Modeling the potential effects of rooftop solar on household energy burden in the United States

Policymakers at the federal and state level have begun to incorporate energy burden into equity goals and program evaluations, aiming to reduce energy burden below a high level of 6% for lower income households in the United States. Pairing an empirical household-level dataset spanning United States geographies together with modeled hourly energy demand curves, we show that rooftop solar reduces energy burden across a majority of adopters during our study period from a median of 3.3% to 2.6%. For low- and moderate-income adopters (at or below 80% and 120% of area median income, respectively), solar reduces median 2021 energy burden from 7.7% to 6.2%, and 4.1% to 3.3%, respectively. Importantly, solar reduces the rate of high or severe energy burden from 67% of all low-income households before adoption to 52% of households following adoption, and correspondingly from 21% to 13% for moderate-income households. Here, we show rooftop solar can support policy goals to reduce energy burden along with strategies such as weatherization and bill assistance.

14 SOLAR ENERGY↗
DOE OSTI2024

ANALYSIS OF SUITABLE METHODOLOGIES FOR COMPRESSOR MASS FLOW RATE CORRECTION TO OTHER SUPERHEAT LEVELS AND REFRIGERANTS

This paper investigates the impact of suction conditions and refrigerant on scroll compressor mass flow rate by using calorimeter tests from AHRI-11 and AHRI-21 reports, published by AHRI's Low-GWP Alternative Refrigerants Evaluation program. Two Copeland scroll compressors (20 and 51 cm3) have been analyzed including different suction conditions (SH = 11K, SH = 22K, Ti = 18ºC) and several refrigerants (R134a, R32, R410A, R404A, etc.). Previous studies have explored response surfaces for energy consumption and mass flow rate variables. This study aims to expand the analysis by identifying the optimal approach to extrapolate mass flow rate from specific suction conditions to others SH or suction temperature levels and refrigerants. The current compressor characterization standard relies on the 1981 Dabiri correlation to correct compressor mass flow rate with suction conditions. Thus, this study aims to assess the adequacy of this correction and explore alternative correction methods for improved results.

Marchante Avellaneda, Javier↗
DOE OSTI2023

Measurement, reporting and Verification (MRV) of non-CO 2 greenhouse gases: International Best Practices and Suggestions for China

Measurement, Reporting, and Verification (MRV) is a systematic approach to tracking and documenting greenhouse gas (GHG) emissions and emission reductions. MRV can be used across all sectors and for all GHGs to track emissions patterns, evaluate programs, and promote transparency. As methane and other short-lived climate pollutants become critical to mitigating near-term climate change impacts, MRV systems become critical in improving emission inventories; facilitating the development of climate change policies and targets, and tracking and demonstrating progress towards sustainable development. This report focuses on current sectoral issues – including the emerging roles for satellites and remote sensing technologies - and international best practices in MRV policies and programs for non-carbon dioxide (CO 2 ) GHGs including methane, nitrous oxide (N 2 O), and hydrofluorocarbons (HFCs) in specific sectors. Based on international best practices and a review of China’s current MRV system, we offer suggestions for a possible path forward for developing and implementing a stronger non-CO 2 MRV system.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Energy Dependent Fission Product Yields (2nd year Milestone and Deliverables)

Introduction to the project: One of the Laboratory missions is to provide consistent, high-precision fission product; yield data critical for testing fission models and maintaining the safety and security of the nation’s nuclear weapons stockpile. However, high-quality, energy-differential fission product yield data is missing for certain actinides and neutron energies important to constrain the new U.S. Nuclear Data Program evaluation effort; It has been shown that the reactor antineutrino anomaly may be at least partially caused by roughly 20 fission products. The fission product yield data is missing or incomplete for many of these isotopes, thus it is necessary to accurately determine these values to better constrain the anomaly; Aitor Bracho is measuring very short-lived (seconds to minutes) fission product yields of 235 U and 239 Pu using monoenergetic neutron beams at E n = 60 and 560 keV; Aitor Bracho is using a direct approach utilizing a state-of-the-art rabbit transfer system, superior HPGe detector, and digital acquisition systems for fission decay measurements. The goals of this project: lop experimental capabilities and data analysis techniques to carry out the gamma-ray spectra analysis necessary for fission product yield calculation; Provide high-precision and energy-dependent fission product data supporting fission theory, neutrino physics, and applied physics.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗