Search NASA⌕ Search

SEARCH · Search NASA

Results for “Program Evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

INL Wireless Test Bed Range Manual

The Wireless Test Bed (WTB) is a customer-focused test and evaluation program that is part of the National and Homeland Security Directorate. This manual describes the WTB’s program, facilities, networks, equipment, and the services available to customers.

99 GENERAL AND MISCELLANEOUS↗

Polymer Compositions in Critical Experiments: Possibly Not What You Think

The Chlorine Worth Study (CWS) Experiment was performed at the National Criticality Experiments Research Center (NCERC) in December 2021. Its goal was to provide a validation benchmark experiment with chlorine and plutonium in the thermal neutron spectrum. This purpose is necessary to reduce the margin of subcriticality in aqueous chloride operations at the Los Alamos National Laboratory Plutonium Facility (PF-4). Reducing the margin of subcriticality will enable higher throughput, required to meet NNSA mission needs. The experiment used layers of plutonium plates, polyethylene (HDPE), aluminum, and polyvinyl chloride (PVC) or chlorinated polyvinyl chloride (CPVC). They were optimized to match plutonium-chloride solutions of 30 g/L, 300 g/L, and 600 g/L. Upon completion of the experiment, a International Criticality Safety Benchmark Evaluation Program (ICSBEP) report was immediately started. The compositions of all materials were assumed pure unless additional information was known (such as for the plutonium plates). During the benchmark analysis, the assumed CPVC composition was questioned. The follow-on work led to lessons learned on compositions in benchmarks. Materials, and specifically polymers, are often much more complex than a basic chemical formula. The CWS experiment is used as an example in this paper to document the lessons learned.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Energy to Communities Program Short Introduction: Evaluation of Enhanced Geothermal System for Cornell District Heating [Slides]

Through the U.S. Department of Energy's Energy to Communities (E2C) program, NLR, other national laboratory experts, and select organizations provide Expert Match - free, short-term technical assistance to address near-term energy challenges and questions. Expert Match is for community stakeholders who have decision-making power or influence in their community but need access to additional energy expertise to inform key upcoming decisions. This Expert Match request supported Cornell University (Itaca, NY) community efforts in developing Enhanced Geothermal System (EGS) reservoir performance, by simulating fracture flow to estimate pressure drop, flow distribution, and heat extraction efficiency in fractured rock. Thermal drawdown modeling was used to assess long-term resource sustainability, while system optimization studies refined key parameters such as well configuration and flow rate to improve overall reservoir efficiency.

15 GEOTHERMAL ENERGY↗

Evaluation of Portable Programming Models to Accelerate LArTPC Detector Simulations

The Liquid Argon Time Projection Chamber (LArTPC) technology is widely used in high energy physics experiments, including the upcoming Deep Underground Neutrino Experiment (DUNE). Accurately simulating LArTPC detector responses is essential for analysis algorithm development and physics model interpretations. Accurate LArTPC detector response simulations are computationally demanding, and can become a bottleneck in the analysis workflow. Compute devices such as General-Purpose Graphics Processing Units (GPGPUs) have the potential to substantially accelerate simulations compared to traditional CPU-only processing. The software development that requires often carries the cost of specialized code refactorization and porting to match the target hardware architecture. With the rapid evolution and increased diversity of the computer architecture landscape, it is highly desirable to have a portable solution that also maintains reasonable performance. We report our ongoing effort in evaluating Kokkos as a basis for this portable programming model using LArTPC simulations in the context of the Wire-Cell Toolkit, a C++ library for LArTPC simulations, data analysis, reconstruction and visualization.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Evaluation of Portable Programming Models to Accelerate LArTPC Detector Simulations

The Liquid Argon Time Projection Chamber (LArTPC) technology is widely used in high energy physics experiments, including the upcoming Deep Underground Neutrino Experiment (DUNE). Accurately simulating LArTPC detector responses is essential for analysis algorithm development and physics model interpretations. Accurate LArTPC detector response simulations are computationally demanding, and can become a bottleneck in the analysis workflow. Compute devices such as General-Purpose Graphics Processing Units (GPGPUs) have the potential to substantially accelerate simulations compared to traditional CPU-only processing. The software development for these compute accelerators often carries the cost of specialized code refactorization and porting to match the target hardware architecture. With the rapid evolution and increased diversity of the computer architecture landscape, it is highly desirable to have a portable solution that also maintains reasonable performance. We report our ongoing effort in evaluating Kokkos as a basis for this portable programming model using LArTPC simulations in the context of the Wire-Cell Toolkit, a C++ library for LArTPC simulations, data analysis, reconstruction and visualization.

47 OTHER INSTRUMENTATION↗

Performance Evaluation of Heterogeneous GPU Programming Frameworks for Hemodynamic Simulations

Preparing for the deployment of large scientific and engineering codes on upcoming exascale systems with GPU-dense nodes is made challenging by the unprecedented diversity of device architectures and heterogeneous programming models. In this work, we evaluate the process of porting a massively parallel, fluid dynamics code written in CUDA to SYCL, HIP, and Kokkos with a range of backends, using a combination of automated tools and manual tuning. We use a proxy application along with a custom performance model to inform the results and identify additional optimization strategies. At scale performance of the programming model implementations are evaluated on pre-production GPU node architectures for Frontier and Aurora, as well as on current NVIDIA device-based systems Summit and Polaris. Real-world workloads representing 3D blood flow calculations in complex vasculature are assessed. Our analysis highlights critical trade-offs between code performance, portability, and development time.

Martin, Aristotle↗

Retracted: Monitoring Hatchery Broodstock Composition and Genetic Variation of Spring/Summer Chinook Salmon in the Columbia River Basin with Multigeneration Pedigrees

Abstract Hatchery production of Chinook Salmon Oncorhynchus tshawytscha in the Columbia River basin comprises most of the anadromous salmonid production in this region. Hatchery facilities and programs serve to mitigate for impacts to salmonids due to the construction and operation of hydropower dams and habitat impacts from development in addition to the conservation and restoration of natural populations. A genetic method referred to as parentage-based tagging (PBT) enables highly reliable detection of hatchery-origin fish and inference of multigeneration pedigrees. This study compiles 11 years of PBT data from nearly 125,000 interior stream-type Chinook Salmon from 24 spawning hatcheries located in tributaries of the mid- and upper Columbia River as well as the Salmon, Clearwater, and Grande Ronde River subbasins. Multigenerational pedigrees allowed investigation of the proportion of natural- and hatchery-origin broodstock (pNOB and pHOB, respectively) for each hatchery and enumeration of the scale of production between segregated and integrated programs. We then compared how pHOB and the scale of production influenced the number of stray fish observed, genetic diversity, relatedness, and age-class compositions within broodstocks. Over 91.0% of hatchery broodstock could be assigned back to their parents, and there was an overall rate of less than 1.0% of broodstock that were unintentionally incorporated into nonnatal hatchery programs. We evaluated 14 segregated programs with 0.0–10.0% pNOB, 7 intermediate programs (10.1–50.0% pNOB), and 3 integrated programs (>50.0% pNOB). There was no correlation between the scale of production or pNOB with the level of genetic diversity, but as production size increased, so did the effective number of breeders. This study demonstrates the utility of PBT as a monitoring tool for hatchery broodstocks, and results suggest that segregated and integrated programs have tradeoffs that generally align with their intended broodstock management purpose of providing fish for harvest and/or fish for supplementation or reintroduction.

Horn, Rebekah L.↗

Multigeneration Pedigrees to Monitor Hatchery Broodstock Composition and Genetic Variation of Spring/Summer Chinook Salmon in the Columbia River Basin

Abstract Hatchery production of Chinook Salmon Oncorhynchus tshawytscha in the Columbia River basin comprises most of the anadromous salmonid production in this region. Hatchery facilities and programs serve to mitigate for impacts to salmonids due to the construction and operation of hydropower dams and habitat impacts from development in addition to the conservation and restoration of natural populations. A genetic method referred to as parentage-based tagging (PBT) enables highly reliable detection of hatchery-origin fish and inference of multigeneration pedigrees. This study compiles 11 years of PBT data from nearly 125,000 interior stream-type Chinook Salmon from 24 spawning hatcheries located on tributaries of the mid- and upper Columbia River and in the Salmon, Clearwater, and Grande Ronde River subbasins. Multigenerational pedigrees allowed for investigation of the proportions of natural- and hatchery-origin broodstock (pNOB and pHOB, respectively) for each hatchery and enumeration of the scale of production between segregated and integrated programs. We then compared how pHOB and the scale of production influenced the number of stray fish observed, genetic diversity, relatedness, and age-class compositions within broodstocks. Over 91.0% of hatchery broodstock could be assigned back to their parents, and overall less than 1.0% of broodstock consisted of fish that were unintentionally incorporated into nonnatal hatchery programs. We evaluated 11 segregated programs with 0.0–10.0% pNOB, 9 intermediate programs (10.1–50.0% pNOB), and 3 integrated programs (>50.0% pNOB). There was no correlation between the scale of production or pNOB with the level of genetic diversity, but as production size increased, so did the effective number of breeders. This study demonstrates the utility of PBT as a monitoring tool for hatchery broodstocks, and results suggest that segregated and integrated programs have tradeoffs that generally align with their intended broodstock management purpose of providing fish for harvest and/or fish for supplementation or reintroduction.

Horn, Rebekah L.↗

Evaluating the effectiveness of program data features for guiding memory management

Recent trends have led to the adoption of larger and more complex memory systems, often with multiple tiers of memory performance within the same platform. To utilize complex memory systems efficiently, current data management strategies must be altered to map usage demands to the underlying hardware. Applications, as the generators of memory accesses, are well-suited to guide this process, but building and maintaining separate source code versions for different memory systems is not feasible in most cases. One potential solution is to employ automated program profiling and analysis to facilitate the production of application-based guidance. By attaching memory usage information to static or lightweight program features, compilers and runtime systems can generate fine-grained guidance without additional efforts from users or developers. Recent works have employed this approach with some success, but it is not clear which program features are most useful for guiding data management.This work evaluates the effectiveness of using different program data features to predict memory usage and guide memory management. It employs a custom set of simulation tools, based in the Intel® Pin framework, to collect and analyze the usage characteristics of application data associated with common program data features, such as allocation sites, types, and context. The results show that even relatively simple features, such as object size, are useful for selecting data with similar usage properties, but finer-grained features, such as the instructions that access a particular object, are often much more effective. Additionally, this work evaluates the performance of using different data features and different program inputs to guide data placement on a heterogeneous memory platform with a limited amount of high performance memory.

Effler, T. Chad↗

Analysis of Abdominal Radiology fellowship website content and comprehensiveness

Purpose: Fellowship programs’ online content plays a key role in prospective Abdominal Radiology applicants’ evaluation of programs. The purpose of this study is to examine the online accessibility of Abdominal Radiology fellowships, the comprehensiveness of the program websites’ content, and evaluate whether specific program characteristics are associated with differentiated website comprehensiveness. Methods: A list of 67 Abdominal Radiology fellowship programs was obtained from the Society of Abdominal Radiology (SAR) website. Each of the 65 publicly-available fellowship websites was scored for the presence of 19 binary variables related to the program’s attributes and curriculum to assess informational comprehensiveness. Comprehensiveness scores were compared by program characteristics (accreditation status, region, and size) using Kruskal–Wallis and two-tailed t tests. Results: Mean comprehensiveness score of Abdominal Radiology fellowship websites as measured by online criteria met was 52.6% (10.0 ± 3.0/19). Application requirements and information, rotation scheduling, and program director contact were found on more than 87.5% of the 65 websites, whereas salary and benefits, social information, and alumni were listed on fewer than 33.8% (22/65) of websites. Program accreditation status, region, and size were not associated with difference in mean comprehensiveness scores. Conclusions: There is a discrepancy between information commonly sought by prospective Abdominal Radiology fellowship applicants and what is available on fellowship program websites. Programs and applicants alike may benefit from programs strengthening their online material.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Building a Clean Energy Workforce: An Evaluation Framework for State Energy Office Workforce Programs

This fact sheet is a summary of the workforce evaluation framework that was first proposed in the white paper, An Evaluation Framework for State Energy Offices' Energy Efficiency and Clean Energy Workforce Program. This evaluation framework was developed to guide State Energy Offices (SEOs) in assessing and enhancing the workforce development programs the manage, fund, or partner on. By following this step-by-step framework, SEOs can evaluate program components, identify areas for improvement, and optimize program outcomes for greater impact.

clean energy↗

140,142 Ce Neutron Cross Section Resolved Resonance Region Evaluation

A resolved resonance region evaluation of 140,142 Ce was conducted by Oak Ridge National Laboratory. Requested by the US Nuclear Criticality Safety Program, this evaluation is based on recent high-resolution transmission and capture high-resolution measurements of nat Ce and 142 Ce conducted at JRC-Geel at the Geel Linear Accelerator facility. It is also based on recently measured thermal constants available from the EX FOR database. Starting from the resonance parameters from the ENDF/B-VIII.0 library and following a preliminary R-matrix analysis, an updated set of resonance parameters and corresponding covariance in formation was derived by the fit of these experimental datasets using the Reich–Moore approximation of the R-matrix theory, as implemented in the SAMMY code system. The resolved resonance region upper energy limit for 140 Ce was kept at 200 keV, whereas the 142 Ce resonance region was extended from 13 to 26 keV. This new evaluation was found to be in good agreement not only with several integral quantities of interest to the reactor physics community, but also with the stellar Maxwellian-averaged cross section.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Evaluation of OpenAI Codex for HPC Parallel Programming Models Kernel Generation

We evaluate AI-assisted generative capabilities on fundamental numerical kernels in high-performance computing (HPC), including AXPY, GEMV, GEMM, SpMV, Jacobi Stencil, and CG. We test the generated kernel codes for a variety of language-supported programming models, including (1) C++ (e.g., OpenMP [including offload], OpenACC, Kokkos, SyCL, CUDA, and HIP), (2) Fortran (e.g., OpenMP [including offload] and OpenACC), (3) Python (e.g., numpy, Numba, cuPy, and pyCUDA), and (4) Julia (e.g., Threads, CUDA.jl, AMDGPU.jl, and KernelAbstractions.jl). We use the GitHub Copilot capabilities powered by the GPT-based OpenAI Codex available in Visual Studio Code as of April 2023 to generate a vast amount of implementations given simple + + prompt variants. To quantify and compare the results, we propose a proficiency metric around the initial 10 suggestions given for each prompt. Results suggest that the OpenAI Codex outputs for C++ correlate with the adoption and maturity of programming models. For example, OpenMP and CUDA score really high, whereas HIP is still lacking. We found that prompts from either a targeted language such as Fortran or the more general purpose Python can benefit from adding code keywords, while Julia prompts perform acceptably well for its mature programming models (e.g., Threads and CUDA.jl). We expect for these benchmarks to provide a point of reference for each programming model's community. Overall, understanding the convergence of large language models, AI, and HPC is crucial due to its rapidly evolving nature and how it is redefining human-computer interactions.

Godoy, William↗

FPDetect: Efficient Reasoning About Stencil Programs Using Selective Direct Evaluation

We present FPDetect, a low-overhead approach for detecting logical errors and soft errors affecting stencil computations without generating false positives. We develop an offline analysis that tightly estimates the number of floating-point bits preserved across stencil applications. This estimate rigorously bounds the values expected in the data space of the computation. Violations of this bound can be attributed with certainty to errors. FPDetect helps synthesize error detectors customized for user-specified levels of accuracy and coverage. FPDetect also enables overhead reduction techniques based on deploying these detectors coarsely in space and time. Experimental evaluations demonstrate the practicality of our approach.

97 MATHEMATICS AND COMPUTING↗

Performance Evaluation of Different Parallel Programming Models in SCALE-Shift Sequences for Criticality and Shielding Applications [Abstract]

The SCALE code system has been widely used for nuclear criticality safety, reactor physics, radiation shielding, source term generation, and inventory analyses by researchers, industry, and regulatory bodies. Although limited support for shared- and distributed-memory parallel processing was introduced via C++ threading, OpenMP, and MPI, a hybrid parallel programming model with both distributed- and shared-memory parallelism has not been fully supported in the SCALE code system.

Nuclear Criticality Safety Program (NCSP)↗