Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Applying queueing theory to evaluate wait-time-savings of triage algorithms

Abstract In the past decade, artificial intelligence (AI) algorithms have made promising impacts in many areas of healthcare. One application is AI-enabled prioritization software known as computer-aided triage and notification (CADt). This type of software as a medical device is intended to prioritize reviews of radiological images with time-sensitive findings, thus shortening the waiting time for patients with these findings. While many CADt devices have been deployed into clinical workflows and have been shown to improve patient treatment and clinical outcomes, quantitative methods to evaluate the wait-time-savings from their deployment are not yet available. In this paper, we apply queueing theory methods to evaluate the wait-time-savings of a CADt by calculating the average waiting time per patient image without and with a CADt device being deployed. We study two workflow models with one or multiple radiologists (servers) for a range of AI diagnostic performances, radiologist’s reading rates, and patient image (customer) arrival rates. To evaluate the time-saving performance of a CADt, we use the difference in the mean waiting time between the diseased patient images in the with-CADt scenario and that in the without-CADt scenario as our performance metric. As part of this effort, we have developed and also share a software tool to simulate the radiology workflow around medical image interpretation, to verify theoretical results, and to provide confidence intervals for the performance metric we defined. We show quantitatively that a CADt triage device is more effective in a busy, short-staffed reading setting, which is consistent with our clinical intuition and simulation results. Although this work is motivated by the need for evaluating CADt devices, the evaluation methodology presented in this paper can be applied to assess the time-saving performance of other types of algorithms that prioritize a subset of customers based on binary outputs.

Thompson, Yee Lam Elim (ORCID:0000000196537707)↗
DOE OSTI2022

A multi-criteria CCUS screening evaluation of the Gulf of Mexico, USA

Continued research into reservoir characterization along with offshore carbon dioxide (CO 2 ) transportation and infrastructure assets is needed to facilitate development of safe and successful carbon capture, utilization, and storage (CCUS) projects. This paper outlines a multi-criteria evaluation methodology that incorporates disparate sets of quantitative, spatially variable data into a decision-making framework for screening the Gulf of Mexico (GOM) outer continental shelf (OCS) for potentially viable CO 2 storage and enhanced oil recovery (EOR) sites. Criteria categories include favorable geologic characteristics, logistics, and potential risks. Data compiled for 14 criteria from several publicly available geographic information system (GIS) layers was aggregated over 2559 spatially balanced points across the study area using the National Energy Technology Laboratory (NETL)-developed Cumulative Spatial Impact Layers™ (CSIL) GIS tool. Criteria are weighted by qualitative expert opinion relative to their perceived importance to given scenarios— the output of combined criteria values and weights enables regional CO 2 storage suitability differentiation. The methodology considers both technical and non-technical factors impacting CCUS decision-making. The flexible methodology enables a systematic approach to regional ranking at high spatial resolution over a large study domain. Additionally, the framework enables high-grading of priority sites that warrant further characterization and follow-on analysis. Areas along the Louisiana coast and Mississippi River Delta consistently rank high for all scenarios largely a result of the favorable geology with the potential for stacked storage, as well as the density of existing pipelines and platforms, and proximity to several onshore CO 2 sources. High-graded regions for the CO 2 EOR-related scenarios are typically located further offshore towards the middle and edge of the OCS compared to higher priority regions for the geologic storage scenarios which fall closer to the Louisiana coastline.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

MARVEL Reactor Digital Engineering Developments

The MARVEL reactor project has served to introduce a new generation of engineers to the processes required to transform a reactor design from simply an idea on paper into what will be an approved, constructed, and operational nuclear power system. Much as there have been advances in materials, analysis, and evaluation methodologies over the 50 years since the last reactor was built at INL, so too has the technology for managing the engineering process itself advanced. Digital Engineering tools and methods provide improved coordination between previously siloed engineering disciplines, reduced burdens of non-value-added data transcription processes and bring forward insights and improvements that might otherwise fall later in the design stage, where changes are much more costly. While the tools and techniques to support the full digital engineering vision are not yet complete, the MARVEL design processes provide valuable demonstrations and validations of key aspects and illuminate further areas for implementation by subsequent projects.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗
DOE OSTI2025

Electrical signaling in fungi: past and present challenges

Abstract Electrical signaling is a fundamental mechanism for integrating environmental stimuli and coordinating responses in living organisms. While extensively studied in animals and plants, the role of electrical signaling in fungi remains a largely underexplored field. Early studies suggested that filamentous fungi generate action potential-like signals and electrical currents at hyphal tips, yet their function in intracellular communication remained unclear. Renewed interest in fungal electrical activity has fueled developments such as the hypothesis that mycorrhizal networks facilitate electrical communication between plants and the emerging field of fungal-based electronic materials. Given their continuous plasma membrane, specialized septal pores, and insulating cell wall structures, filamentous fungi possess architectural features that could support electrical signaling over long distances. However, studying electrical phenomena in fungal networks presents unique challenges due to the microscopic dimensions of hyphae, the structural complexity of highly modular mycelial networks, and the limitations of traditional electrophysiological methods. This review synthesizes current evidence for electrical signaling in filamentous fungi, evaluates methodological approaches, and highlights experimental challenges. By addressing these challenges and identifying best practices, we aim to advance research in this field and provide a foundation for future studies exploring the role of electrical signaling in fungal biology.

Buffi, Matteo↗
DOE OSTI2026

From Rules to Reasoning: A Survey of Large Language Model-Based Approaches to Scientific Hypothesis and Idea Generation

Scientific hypothesis generation represents a fundamental challenge in contemporary research due to exponentially expanding literature volumes and increasing disciplinary specialization. Large language models (LLMs) have emerged as transformative tools for automated scientific discovery, moving beyond traditional rule-based and literature-mining approaches. Four paradigmatic approaches define current LLM-driven hypothesis generation: direct prompting and fine-tuning methods, knowledge-enhanced frameworks integrating retrieval-augmented generation (RAG), multi-agent collaborative systems simulating research teams, and reasoning-focused approaches implementing cognitive architectures. Domain-specific applications demonstrate statistical equivalence to human expert performance in social psychology, experimental validation in biomedical research, and near-expert quality in astronomy. Evaluation methodologies encompass human expert assessment, LLM-as-judge frameworks, and comprehensive benchmarking systems. Technical challenges include hallucination management, knowledge integration limitations, and balancing novelty with feasibility. Future directions emphasize hybrid neural-symbolic architectures and sophisticated human-AI collaboration models for responsible scientific discovery acceleration.

AI-driven discovery↗
DOE OSTI2022

GIF Supercritical Water Cooled Reactor: Proliferation Resistance and Physical Protection White Paper

This report is part of a series of six white papers, prepared jointly by the Proliferation Resistance and Physical Protection Working Group (PRPPWG) and the six System Steering Committees (SSCs) and provisional System Steering Committees (pSSCs). This publication is an update to a similar series published in 2011 presenting the status of Proliferation Resistance & Physical Protection (PR&PP) characteristics for each of the six systems selected by the Generation IV International Forum (GIF) for further research and development, namely: the Sodium-cooled fast Reactor (SFR), the Very high temperature reactor (VHTR), the gas-cooled fast reactor (GFR), the Molten salt reactor (MSR) and the Supercritical water–cooled reactor (SCWR). This white paper represents the status of Proliferation Resistance and Physical Protection (PR&PP) characteristics for the Supercritical Water-cooled Fast reactor (SCFR) reference designs selected by the Generation IV International Forum (GIF) SCWR System Steering Committee (SSC). The intent is to generate preliminary information about the PR&PP features of the SCWR reactor technology and to provide insights for optimizing their PR&PP performance for the benefit of SCWR system designers. It updates the SCWR analysis published in the 2011 report “Proliferation Resistance and Physical Protection of the Six Generation IV Nuclear Energy Systems”, prepared Jointly by the Proliferation Resistance and Physical Protection Working Group (PRPPWG) and the System Steering Committees and provisional System Steering Committees of the Generation IV International Forum, taking into account the evolution of both the systems, the GIF R&D activities, and an increased understanding of the PR&PP features. The white paper, prepared jointly by the GIF PRPPWG and the GIF SCWR SSC, follows the highlevel paradigm of the GIF PR&PP Evaluation Methodology to investigate the PR&PP features of the eight proposed GIF SCWR designs. Two small modular reactors, the Canadian SSR and the Canada/China/Europe ECC-SMART are also mentioned. An overview of the fuel cycles for the GIF designs are provided. For PR, the document analyses and discusses the proliferation resistance aspects in terms of robustness against State-based threats associated with diversion of materials, misuse of facilities, breakout scenarios, and production in clandestine facilities. Similarly, for PP, the document discusses the robustness against theft of material and sabotage by non-State actors. The document follows a common template adopted by all the white papers in the updated series.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

GIF Gas Cooled Fast Reactor: Proliferation Resistance and Physical Protection White Paper

This white paper represents the status of Proliferation Resistance and Physical Protection (PR&PP) characteristics for the Gas-cooled Fast reactor (GFR) reference designs selected by the Generation IV International Forum (GIF) GFR System Steering Committee (SSC). The intent is to generate preliminary information about the PR&PP features of the GFR reactor technology and to provide insights for optimizing their PR&PP performance for the benefit of GFR system designers. It updates the GFR analysis published in the 2011 report “Proliferation Resistance and Physical Protection of the Six Generation IV Nuclear Energy Systems”, prepared Jointly by the Proliferation Resistance and Physical Protection Working Group (PRPPWG) and the System Steering Committees and provisional System Steering Committees of the Generation IV International Forum, taking into account the evolution of both the systems, the GIF R&D activities, and an increased understanding of the PR&PP features. The white paper, prepared jointly by the GIF PRPPWG and the GIF GFR SSC, follows the high-level paradigm of the GIF PR&PP Evaluation Methodology to investigate the PR&PP features of the GIF GFR 2400 MWth reference design. The ALLEGRO reactor is also described. The EM2 and HEN MHR reactor are mentioned. An overview of fuel cycle for the GFR reference design and for the ALLEGRO reactor are provided. For PR, the document analyses and discusses the proliferation resistance aspects in terms of robustness against State-based threats associated with diversion of materials, misuse of facilities, breakout scenarios, and production in clandestine facilities. Similarly, for PP, the document discusses the robustness against theft of material and sabotage by non-State actors. The document follows a common template adopted by all the white papers in the updated series.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

GIF Very High Temperature Reactor: Proliferation Resistance and Physical Protection White Paper

This report is part of a series of six white papers, prepared jointly by the Proliferation Resistance and Physical Protection Working Group (PRPPWG) and the six System Steering Committees (SSCs) and provisional System Steering Committees (pSSCs). This publication is an update to a similar series published in 2011 presenting the status of Proliferation Resistance & Physical Protection (PR&PP) characteristics for each of the six systems selected by the Generation IV International Forum (GIF) for further research and development, namely: the Sodium-cooled fast Reactor (SFR), the Very high temperature reactor (VHTR), the gas-cooled fast reactor (GFR), the Molten salt reactor (MSR) and the Supercritical water–cooled reactor (SCWR). This white paper represents the status of Proliferation Resistance and Physical Protection (PR&PP) characteristics for the Very-High-Temperature Reactor (VHTR) reference designs selected by the Generation IV International Forum (GIF) VHTR System Steering Committee (SSC). The intent is to generate preliminary information about the PR&PP features of the VHTR reactor technology and to provide insights for optimizing their PR&PP performance for the benefit of VHTR system designers. It updates the VHTR analysis published in the 2011 report “Proliferation Resistance and Physical Protection of the Six Generation IV Nuclear Energy Systems”, prepared Jointly by the Proliferation Resistance and Physical Protection Working Group (PRPPWG) and the System Steering Committees and provisional System Steering Committees of the Generation IV International Forum, taking into account the evolution of both the systems, the GIF R&D activities, and an increased understanding of the PR&PP features. The white paper, prepared jointly by the GIF PRPPWG and the GIF VHTR SSC, follows the high-level paradigm of the GIF PR&PP Evaluation Methodology to investigate the key points of PR&PP features extracted from the reference designs of VHTRs under consideration in various countries. A major update from the 2011 report is an explicit distinction between prismatic block-type VHTRs and pebble-bed VHTRs. The white paper also provides an overview of the TRISO fuel and fuel cycle. For PR, the document analyses and discusses the proliferation resistance aspects in terms of robustness against State-based threats associated with diversion of materials, misuse of facilities, breakout scenarios, and production in clandestine facilities. Similarly, for PP, the document discusses the robustness against theft of material and sabotage by non-State actors. The document follows a common template adopted by all the white papers in the updated series.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Closed-Loop Pumped Storage Hydropower Resource Assessment for the United States. Final Report on HydroWIRES Project D1: Improving Hydropower and PSH Representations in Capacity Expansion Models

Pumped storage hydropower represents the bulk of the United States' current energy storage capacity: 23 gigawatts (GW) of the 24-GW national total (Denholm et al. 2021). This capacity was largely built between 1960 and 1990. PSH is a mature and proven method of energy storage with competitive round-trip efficiency and long life spans. These qualities make PSH a very attractive potential solution to energy storage needs, particularly for longer-duration storage (8 hours or more); such storage will be crucial to bridge gaps in electricity production as variable wind and solar production continue to comprise an ever-larger portion of the United States' energy portfolio (Cole et al. 2021; Frazier et al. 2021). However, it is unclear how much potential the United States has for the development of new PSH. No new large PSH has been constructed in the United States since the 1990s, and attempts to quantify technical potential capacity from PSH project applications to the Federal Energy Regulatory Commission (FERC) suffer from inconsistent site and cost evaluation methodologies and likely are not representative of all PSH opportunities. This study seeks to better under understand the technical potential for PSH development in the United States by developing a national-scale resource assessment for closed-loop PSH. Individual sites are not modeled in sufficient detail for project-level development, but they do provide valuable insights into potential resource areas across the United States, including the ability to provide estimates for a range of long-term development scenarios.

13 HYDRO ENERGY↗
DOE OSTI2021

Benchmark Comparison of HyRAM and ALDEA Software for Hydrogen Release Behavior

There are several different calculation approaches and tools that can be used to evaluate the risk of hydrogen energy applications. A comparative study of Air Liquide’s ALDEA (Air Liquide Dispersion and Explosion Assessment) tools suite and Sandia’s HyRAM (Hydrogen Risk Assessment Models) toolkit has been conducted. The purpose of this study was to understand and evaluate the differences between the two calculation approaches, and identify areas for model improvements. There were several scenarios examined in this effort regarding hydrogen release dynamics. These scenarios include free jet release cases at varying pressures, vessel blowdown, and hydrogen build-up scenarios with and without ventilation. For each scenario, the input and output of the HyRAM calculations are documented, along with a comparison to the ALDEA results. Generally, the results from the two different tools were reasonably aligned. However, there were fundamental differences in evaluation methodology and functional limitations in HyRAM that caused discrepancies in some calculations.

08 HYDROGEN↗
DOE OSTI2022

A Real-Time Operations Manual for the IEEE 118 Bus Transmission Model

This document presents a sample operations manual for the IEEE 118 Bus Model, which is a synthetic test case developed in 1962 from a section of the transmission grid operated by American Electric Power (AEP). The model is one of the most used synthetic test cases for development of power system applications and is referenced by over 9000 papers. However, the model lacks any context for use with real-time energy management system (EMS) applications, including common considerations, such as generator ramp rates, reactive capabilities, operating limits, and other information typically used by power system operators for real-time decision making. This manual divides the IEEE 118 Bus Model into three operating areas, defines various operating limits, and sets recommended operating procedures for responding to a few types of emergency operating conditions. The manual can be used in support of a wide variety of human-in-the-loop evaluation methodologies for new advanced power applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Mechanical properties of Zircaloy cladding tubes and contributions to M.E.T.A. mechanical property database

To support a multi-laboratory Methodology, Evaluation, Testing, and Analysis (M.E.T.A.) cladding properties database, Oak Ridge National Laboratory’s (ORNL’s) cladding mechanical test geometries were manufactured from several nuclear-relevant cladding alloys and subsequently tested. These geometries were developed as mechanical test specimens to evaluate the properties of tube materials that may be used for irradiation testing at ORNL’s High Flux Isotope Reactor. They may also be used as test articles to be harvested—via in-cell machining—from commercially irradiated fuel rods and later tested. This report explores the differences among axial, hoop, and SSJ tensile geometries with partially recrystallized Zircaloy-2 to test ORNL correlation-based methods on a plate material that approximates, to the greatest extent possible, the characteristics of nuclear industry tubing. Furthermore, several tests were conducted with ORNL’s Zircaloy-4 tube inventory to (1) develop material properties as a standard for future tests, (2) determine the effect of the US Department of Energy’s Advanced Fuels Campaign coating processes on tube mechanical properties, and (3) evaluate the effect of specimen machining methods on the mechanical properties of tube geometries.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Consistent $\overline{ν}$ evaluation for minor U isotopes with $\tt{CGMF}$

Following several successful prompt $\overline{ν}$ evaluations using $\tt{CGMF}$, including consistent evaluations for minor Pu isotopes, we detail in this report our efforts to perform a consistent $\overline{ν}$ evaluation for minor U isotopes during FY25. Although we have not yet produced a finalized evaluation, we present the progress that we have made towards such an evaluation for 232,233,234,236,237,239 U prompt $\overline{ν}$. Our milestone explicitly calls out evaluations for 233 U, 234 U, and 236 U, however, to better constrain the model with reliable experimental $\overline{ν}$ data, we also include 235 U and 238 U in the evaluation procedure. Then, we additionally produce evaluations for 232 U, 237 U and 239 U $\overline{ν}$ as a byproduct. Elsewhere, we will report our efforts on a stand-alone 233 U $\overline{ν}$ evaluation. This report is organized in the following manner. In Sec. 2, we briefly outline the updates to CGMF that were needed to be able to calculate all of these minor U fission reactions. The experimental data overview is given in Sec. 3. The evaluation methodology and results are presented in Secs. 4 and 5, respectively. Finally, we conclude and outline work for FY26 in Sec. 6.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2026

A Play-Based Exploration of CO 2 Storage in the Illinois Basin (Final Technical Report)

This report documents the results of "A Play-Based Exploration of CO₂ Storage in the Illinois Basin" (DE-FE0032366), a project funded by the U.S. Department of Energy Office of Fossil Energy and Carbon Management and conducted by the Illinois State Geological Survey (ISGS) at the University of Illinois Urbana-Champaign in partnership with Visage Energy. The project adapted play-based exploration (PBE), a systematic basin-scale evaluation methodology from the petroleum industry, to screen areas of Illinois for commercial geologic carbon storage (GCS) in Cambro-Ordovician strata. The traditional play concept was expanded to encompass three play element groups, subsurface geologic factors, surface features, and societal factors, yielding 24 play elements with defensible suitability criteria applied through a five-tier classification scheme. An integrated geospatial database was assembled from ISGS, MGSC, MRCI, NATCARB, and public data sources, supported by significant data-improvement work including correction of legacy well locations, digitization of more than 1,300 well construction records using the DOE CATALOG team's OGRRE tool, compilation of a statewide 2D seismic database, and production of a refined fault and fold geodatabase.

58 GEOSCIENCES↗
DOE OSTI2024

Carbonated Brine Injection as a Low-Risk CO2 Storage Strategy: A Case Study for Inyan Kara Sandstone Reservoir

Carbonated brine storage is a low-risk geologic CO2 sequestration strategy compared to traditional supercritical CO2 injection and storage. Our study provides an evaluation methodology for CBI that can be used for other potential pilot injections in suitable fields and opens the opportunity to work with industry for CBI using existing Class II wells to gain CO2 tax credits.

Xiong, Wei↗
DOE OSTI2023

MSR Proliferation Resistance and Physical Protection White Paper

This document represents the status of Proliferation Resistance and Physical Protection (PR&PP) characteristics for the Molten Salt Reactor designs selected by the Generation IV International Forum (GIF) Molten Salt Reactor (MSR) provisional System Steering Committee (pSSC) as representatives of three broad classes of MSRs. The three classes of MSRs are: (1) Liquid-fueled with integrated salt processing, (2) Liquid-fueled without integrated salt processing, (3) Solid-fueled with salt coolant. The intent is to generate preliminary information about the PR&PP merits of the MSR Reactor Technology and to provide insights for optimizing their PR&PP performance for the benefit of MSR system designers. It updates the MSR analysis published in the 2011 report “Proliferation Resistance and Physical Protection of the Six Generation IV Nuclear Energy Systems”, prepared Jointly by the Proliferation Resistance and Physical Protection Working Group (PRPPWG) and the System Steering Committees of the Generation IV International Forum, taking into account the evolution of both the systems and the GIF R&D activities since its publication. The document, prepared jointly by the GIF PRPPWG and the GIF MSR pSSC, follows the high-level paradigm of the GIF Proliferation Resistance and Physical Protection Evaluation Methodology to investigate the Proliferation Resistance and Physical Protection features of the GIF MSR representative designs. For PR, the document analyses and discusses the proliferation resistance aspects in terms of robustness against State-based threats associated with diversion of materials, misuse of facilities, breakout scenarios, and production in clandestine facilities. Similarly, for physical protection, the document discusses the robustness against theft of material and sabotage by non-State actors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Evaluation of printability methodologies and feasibility to down select LBPF steel and other materials for nuclear applications

In this work, new research is underway to produce alloys beyond well-known alloys with modified compositions that are better suited to be produced with additive manufacturing. These alloys can only possess improved radiation tolerance but also improved high temperature strength, creep resistance while also using elements that reduce the amount of activation after irradiation. This work package supports the vision and goals of the Advanced Materials and Manufacturing Technology (AMMT) program relevant to accelerate the development and deployment of advanced manufacturing processes. This work focuses on evaluating the methodology for designing alloys best suited for AM processes based on “printability”, literature research to evaluate and down select steel alloy systems. In this work, microstructural characterization and testing activities have been performed on certain steel alloys to support the efforts from collaborating laboratories during the evaluation and printing of the test articles. The final recommendation will be performed by all four participating laboratories.

316L↗