Search NASA⌕ Search

SEARCH · Search NASA

Results for “contextual refinement”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Enhancing Operational Safety via Agentic Dialogue Hazard Identification Analysis

Operational safety in high-stakes domains such as industrial process control, autonomous, and safety-critical systems demand reliable hazard identification. While large language models (LLMs) have shown promise in automating safety analysis tasks, single-turn, monolithic inference is brittle: it lacks the self-correction, deliberation, and contextual refinement that safety engineers apply iteratively. In this paper, we introduce HAZDIAL, a framework that investigates whether structured agentic dialogue (multi-agent, multi-turn interactions) improves the quality of NLP-based hazard identification over single-pass baselines. We systematically compare two dialogue modalities: adversarial debate and constructive discussion, and propose an genetic algorithm-based agentic interaction optimization. We evaluate all configurations against a curated golden dataset using standard classification metrics (accuracy, precision, recall, F1) and a novel dialogue metrics. This work advances the intersection of dialogue systems, multi-agent reasoning, and AI safety, providing empirical evidence for dialogue-driven hazard analysis.

Das, Sanjay [ORNL] (ORCID:0009000542591915)↗

Compositional Reasoning for Hierarchical State Machines

Harel statecharts and its derivatives are popular graphical languages for specifying discrete control systems via hierarchical state machines. Separately, there has been a long line of work on specifying concurrent systems with process calculi which come equipped with an algebraic theory, the ability reason compositionally about various temporal properties, and strong type systems. While these two approaches to modeling systems are tantalizingly similar, the integrated reasoning principles that exist for process calculi have not been demonstrated in hierarchical state machines. A key issue is that operational theories for process calculi do not behave like control systems, and thus, there is virtually no tool support for modeling control systems with such languages. For a control system designer, bringing the integrated, more scalable reasoning from the process calculi to state-machine languages would enable the specification of more complex systems and a more modular systems development process. Our insight is that we can recover many important results from the process calculi in hierarchical state machines with local scope. We employ a structural operational semantics, which is ubiquitous in process and 𝜆-calculi but uncommon in hierarchical statemachine formalizations, to enable inductive reasoning about behavior. Taking inspiration from the structure of process calculi metatheories, we define a calculus of refinement and equivalence that we prove sound with respect to local notion of (bi)simulation. Furthermore, we prove that the calculus preserves the behavioral properties of reactivity, observational determinism, traces, and linear temporal properties. Our results are mechanized in the Rocq proof assistant.

97 MATHEMATICS AND COMPUTING↗

Local Resource Assessment: Beetle-Killed Spruce in Alaska

This report synthesizes forest inventory and spatial data from federal and state sources to present a snapshot of beetle-killed spruce across Southcentral and Interior Alaska. This natural resource is under investigation for use in cellulose-based products, particularly building insulation. Research funded by the Department of Energy's ARPA-E program, has successfully developed insulation - Celium - using beetle-killed spruce combined with mycelium, the root network of fungi. The resulting insulation product can be manufactured locally and used across all Alaskan climate zones for residential, commercial, and shipping applications. Removing standing dead wood also contributes to wildfire risk reduction and mitigates associated public health impacts. This Local Resource Assessment, funded by the Denali Commission, contextualizes and reconciles unaligned forestry data sources, establishing a pathway to refined, replicable analysis and, ultimately, presenting estimates of beetle-killed spruce biomass to inform the potential scale and development of a Celium industry.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Atomic Layer Deposition for Improved Biomass Conversion Catalysts

Heterogeneous catalysts are a key enabler of the transition towards a sustainable, bio-based economy for fuels and chemicals. However, the harsh conditions in many biomass conversion processes lead to nanoparticle sintering, support collapse, and metal leaching in conventional PGM catalysts. Next-generation catalysts must be developed to address these stability challenges. This presentation will discuss ongoing work between the Catalytic Carbon Transformation and Scale-Up Center at NREL and various industrial partners to develop scalable and cost-effective atomic layer deposition (ALD) coatings for improving the performance of biomass conversion catalysts. The substantial focus will be devoted to the benefits of TiO2 ALD coatings on supported Pd hydrogenation catalysts. Ten cycles of TiO2 ALD were found to dramatically improve the activity of a conventional Pd/Al2O3 catalyst towards aromatic hydrogenation, despite partial coverage of the Pd sites by the ALD layer. Subsequent advanced characterization and atomic-scale computational modeling revealed that the ALD coating weakened the adsorption strength of hydrogenation surface intermediates, leading to higher reaction rates. Reaction testing after exposure to sulfur impurities, high temperature oxidation, and hydrothermal treatment demonstrated the improved stability of the ALD-coated catalyst. Additionally, the ALD synthesis process was found to be scalable over two orders of magnitude with minimal deviation in synthesized catalyst properties. These results were contextualized with cost models of industrial ALD coating and aromatic hydrogenation processes to further refine the value proposition of ALD coatings. Given the demonstrated improvements in hydrogenation, TiO2 ALD coatings have also been applied to supported Pt catalysts for use in other biomass conversion reactions, such as hydrodeoxygenation for the production of sustainable aviation fuel (SAF) and the oxidation of glucose to bio-derived gluconic acid.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Atomic Layer Deposition for Improved Biomass Conversion Catalysts

Heterogeneous catalysts are a key enabler of the transition towards a sustainable, bio-based economy for fuels and chemicals. However, the harsh conditions in many biomass conversion processes lead to nanoparticle sintering, support collapse, and metal leaching in conventional PGM catalysts. Next-generation catalysts must be developed to address these stability challenges. This presentation will discuss ongoing work between the Catalytic Carbon Transformation & Scale-Up Center at NREL and various industrial partners to develop scalable, cost-effective atomic layer deposition (ALD) coatings for improving the performance of biomass conversion catalysts. Substantial focus will be devoted to the benefits of TiO2 ALD coatings on supported Pd hydrogenation catalysts. Ten cycles of TiO2 ALD were found to dramatically improve the activity of a conventional Pd/Al2O3 catalyst towards aromatic hydrogenation, despite partial coverage of the Pd sites by the ALD layer. Subsequent advanced characterization and atomic-scale computational modeling revealed that the ALD coating influenced the adsorption strength of hydrogenation surface intermediates in unexpected ways, leading to higher reaction rates. Reaction testing after exposure to sulfur impurities, high temperature oxidation, and hydrothermal treatment demonstrated the improved stability of the ALD-coated catalyst. Additionally, the ALD synthesis process was found to be scalable over two orders of magnitude with minimal deviation in synthesized catalyst properties. These results were contextualized with cost models of industrial ALD coating and aromatic hydrogenation processes to further refine the value proposition of ALD coatings. Given the demonstrated improvements in hydrogenation, TiO2 ALD coatings have also been applied to supported Pt catalysts for use in other biomass conversion reactions, such as hydrodeoxygenation for production of sustainable aviation fuel (SAF) and the oxidation of glucose for bio-derived gluconic acid. Recent findings from these experimental campaigns will also be shared. ALD technology holds great potential in the development of next-generation catalysts for biofuels and bioproducts and this work constitutes an important examination of the impact of ALD coatings in a variety of reaction environments.

bioenergy↗

Atomic Layer Deposition for Improved Biomass Conversion Catalysts

Heterogeneous catalysts are a key enabler of the transition towards a sustainable, bio-based economy for fuels and chemicals. However, the harsh conditions in many biomass conversion processes lead to nanoparticle sintering, support collapse, and metal leaching in conventional PGM catalysts. Next-generation catalysts must be developed to address these stability challenges. This presentation will discuss ongoing work between the Catalytic Carbon Transformation and Scale-Up Center at NREL and various industrial partners to develop scalable and cost-effective atomic layer deposition (ALD) coatings for improving the performance of biomass conversion catalysts. The substantial focus will be devoted to the benefits of TiO2 ALD coatings on supported Pd hydrogenation catalysts. Ten cycles of TiO2 ALD were found to dramatically improve the activity of a conventional Pd/Al2O3 catalyst towards aromatic hydrogenation, despite partial coverage of the Pd sites by the ALD layer. Subsequent advanced characterization and atomic-scale computational modeling revealed that the ALD coating weakened the adsorption strength of hydrogenation surface intermediates, leading to higher reaction rates. Reaction testing after exposure to sulfur impurities, high temperature oxidation, and hydrothermal treatment demonstrated the improved stability of the ALD-coated catalyst. Additionally, the ALD synthesis process was found to be scalable over two orders of magnitude with minimal deviation in synthesized catalyst properties. These results were contextualized with cost models of industrial ALD coating and aromatic hydrogenation processes to further refine the value proposition of ALD coatings. Given the demonstrated improvements in hydrogenation, TiO2 ALD coatings have also been applied to supported Pt catalysts for use in other biomass conversion reactions, such as hydrodeoxygenation for the production of sustainable aviation fuel (SAF) and the oxidation of glucose to bio-derived gluconic acid. Recent findings from these experimental campaigns will also be shared. ALD technology holds great potential in the development of next-generation catalysts for biofuels and bioproducts, and this work constitutes an important examination of the impact of ALD coatings in a variety of reaction environments.

atomic layer deposition↗

Sequential Decision Making (SDM) for Mesh Refinement and Model Selection in Multiscale, Multi-Physics Applications

Intelligent automation and decision support are needed to enhance computational efficiency and robustness in multiscale and multi-physics problems, including materials science, manufacturing, and climate and weather modeling. Current scientific computing approaches for enabling decisions by scientists fail to explore the role of learning, reasoning, and probabilistic planning. Often these decisions are not performed in real-time during the computation but are made prior to the start of the computation, which must be interrupted in order to make changes to the prior choices. Such interruptions at different stages of the computation increase the total computing time and the need for a human expert to frequently monitor the results. State of art scientific computing methods consist of rule-based algorithms that cannot automatically adapt to a dynamically changing computing environment. The development of a Sequential Decision Making (SDM) framework will automate scientific computing by optimizing the policies for mesh refinement, time-stepping, model and algorithm selection, resource allocation, and pre and post-processing. Our agent SDM framework for scientific computing will consist of data-driven learning (Classifier), automated reasoning (contextual knowledge), and probabilistic planning (Reinforcement Learning). In this project, we focused on three problems to demonstrate our SDM framework on a set of ordinary and partial differential equations. Classification of Lorenz system regions using Feed-Forward Neural Networks examined learning in the SDM framework. On the other hand, reasoning and planning in the SDM framework were used in two problems: adaptive time-stepping for nonlinear ODEs using on-policy RL algorithms, and adaptive mesh refinement for 2-D PDEs using off-policy RL algorithms.

97 MATHEMATICS AND COMPUTING↗

Privacy-Aware RAG-Enabled LLMs for Collaborative AI in Organizations

Recent advancements in Large Language Models (LLMs) based on Transformer architectures have significantly improved capabilities in natural language processing and generation. However, deploying LLMs for inter-organizational communication poses challenges, in ensuring privacy and facilitating effective collaboration. This paper introduces a novel decentralized inference meta-agent chatbot that leverages privacy-aware Retrieval-Augmented Generation (RAG)-enabled LLMs for collaborative AI communication across organizations. Built on Microsoft’s Autogen, the platform enables LLMs to autonomously refine responses, enhancing accuracy and relevance. It incorporates advanced hallucination mitigation techniques using Uptrain and a privacy-focused RAG framework that employs synthetic document generation to protect sensitive information. Comprehensive evaluations demonstrate the platform’s effectiveness in maintaining contextual relevance and stringent privacy standards, effectively addressing critical challenges in LLM-enhanced collaborative AI communication. This work represents a significant step toward secure and efficient inter-organizational collaboration using advanced generative AI technologies.

97 - MATHEMATICS AND COMPUTING↗

Learning Global Proliferation Expertise Evolution Using AI-Driven Analytics and Public Information

Detecting and anticipating global proliferation expertise and capability evolution from unstructured, noisy, and incomplete public data streams is a highly desired, but extremely challenging task. Here, in this article, we present our pioneering data-driven approach to support the non-proliferation mission to detect and explain the evolution of proliferation expertise and capability development globally from terabytes of publicly available information (PAI), focusing on our knowledge extraction pipeline and descriptive analytics. We first discuss how we fuse nine open-source data streams, including multilingual data, to convert 4 TB of unstructured data to structured knowledge and encode dynamically evolving proliferation expertise representations—content and context graphs. For this, we rely on natural language processing (NLP) and deep learning (DL) models to perform information extraction, topic modeling, and distributed text representation (aka embedding) learning. We then present interactive, usable, and explainable descriptive analytics to refine domain knowledge and present it in a human-understandable form. Finally, we introduce future work avenues that will leverage our dynamic knowledge representations and descriptive analytics to enable predictive and prescriptive inferences to achieve real-time domain understanding and contextual reasoning about global proliferation expertise and capability evolution.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Predictive Indicators of the Performance of Large Language Models

In several mission contexts, it is desirable to estimate the performance of large language models (LLMs) on tasks that we cannot run directly. In light of published “scaling laws” our hypothesis is that some tasks should be consistently more challenging than others based on characteristics of the task. The goal of this project was to begin quantifying how much information about LLM performance can be gained from the features of a model and a task. Two of our statistical models struggled to converge. Pass/fail test results may provide limited information for inference beyond model quality and task difficulty, but we see no evidence at this time for significant feature interaction effect sizes, arguing for simple models. Future work extending the models to capitalize on perplexity of ground truth answers is suggested. This project also introduces “Depth of Knowledge Variant Testing” as a strategy for more finely assessing language models on open domain question and answer tasks. We developed sets of questions that ask a language model to produce similar information while demonstrating increasing depth of knowledge, and also relabeled existing Q&A test questions with their depth of knowledge. Our results suggest further consideration of Bloom’s taxonomy and further refinement of prompts to properly elicit information at varying depths. In the course of this work, we set up a basic infrastructure for standardizing tasks and testing many language models on these tasks. In addition to testing the predictive quality of model features and performance across test suites, with this project we have introduced two new task features to contextualize each test question: the Dewey Classification main category of information covered, and the Bloom’s taxonomy level that corresponds to the depth of knowledge probed by the question. Splits across these and other features produced over five hundred task subtypes with distinct feature vectors, which we tested on half a dozen models.

97 MATHEMATICS AND COMPUTING↗

Evaluation of the 2022 West Nile virus forecasting challenge, USA

Abstract Background West Nile virus (WNV) is the most common cause of mosquito-borne disease in the continental USA, with an average of ~1200 severe, neuroinvasive cases reported annually from 2005 to 2021 (range 386–2873). Despite this burden, efforts to forecast WNV disease to inform public health measures to reduce disease incidence have had limited success. Here, we analyze forecasts submitted to the 2022 WNV Forecasting Challenge, a follow-up to the 2020 WNV Forecasting Challenge. Methods Forecasting teams submitted probabilistic forecasts of annual West Nile virus neuroinvasive disease (WNND) cases for each county in the continental USA for the 2022 WNV season. We assessed the skill of team-specific forecasts, baseline forecasts, and an ensemble created from team-specific forecasts. We then characterized the impact of model characteristics and county-specific contextual factors (e.g., population) on forecast skill. Results Ensemble forecasts for 2022 anticipated a season at or below median long-term WNND incidence for nearly all (> 99%) counties. More counties reported higher case numbers than anticipated by the ensemble forecast median, but national caseload (826) was well below the 10-year median (1386). Forecast skill was highest for the ensemble forecast, though the historical negative binomial baseline model and several team-submitted forecasts had similar forecast skill. Forecasts utilizing regression-based frameworks tended to have more skill than those that did not and models using climate, mosquito surveillance, demographic, or avian data had less skill than those that did not, potentially due to overfitting. County-contextual analysis showed strong relationships with the number of years that WNND had been reported and permutation entropy (historical variability). Evaluations based on weighted interval score and logarithmic scoring metrics produced similar results. Conclusions The relative success of the ensemble forecast, the best forecast for 2022, suggests potential gains in community ability to forecast WNV, an improvement from the 2020 Challenge. Similar to the previous challenge, however, our results indicate that skill was still limited with general underprediction despite a relative low incidence year. Potential opportunities for improvement include refining mechanistic approaches, integrating additional data sources, and considering different approaches for areas with and without previous cases. Graphical Abstract

54 ENVIRONMENTAL SCIENCES↗

Conducting more inclusive solar geoengineering research: A feminist science framework

Solar geoengineering, or deliberate climate modification, has been receiving increased attention in recent years. Given the far-reaching consequences of any potential solar geoengineering deployments, it is prudent to identify inherent biases, blind spots, and other potential issues at all stages of the research process. Here we articulate a feminist science-based framework to concretely describe how solar geoengineering researchers can be more inclusive of different perspectives and potentially contradictory conclusions, in the process illuminating potential implicit bias and enhancing the conclusions that can be gained from their studies. Importantly, this framework is an adoptable method of practice that can be refined, with the aim of conducting better research in solar geoengineering. As an illustration, we retrospectively apply this framework to a well-read solar geoengineering study (also led by the first author of this study), improving transparency by revealing its implicit values, conclusions made from its evidence base, and the methodologies that study pursues. We conclude here with a set of recommendations for the geoengineering research community whereby more inclusive research can become a regular part of practice. Throughout this process, we illustrate how feminist science scholars can use this approach to study climate modeling.

54 ENVIRONMENTAL SCIENCES↗

Prioritizing ICS Beachhead Systems for Cyber Vulnerability Testing

Cyber Testing for Resilient Industrial Control Systems™ (CyTRICS™) is the Department of Energy’s (DOE’s) program for cybersecurity vulnerability testing, digital subcomponent enumeration, and forensic assessment. CyTRICS leverages best-in-class test facilities and analytic capabilities at six DOE National Laboratories and strategic partnerships with key stakeholders including technology developers, manufacturers, asset owners and operators, and interagency partners. During the program’s development, CyTRICS established a unique methodology for prioritizing digital components within operational technology (OT) and industrial control systems (ICS) in the Energy Sector Industrial Base (ESIB) for cyber vulnerability testing. The CyTRICS Prioritization Process leverages multiple characteristics of systems, components, and their contextual deployment to calculate a quantification of individual digital components for CyTRICS testing. The initial version of the CyTRICS Prioritization Process was premised largely upon the impact which could result to an industrial control system if the digital component under testing was compromised, either through malicious means, faulty engineering, or other modes. The worldwide compromise of the SolarWinds Orion platform, first reported in December 2020, through malicious interference with the digital patching cycle was a watershed event in cyber supply chain security. The SolarWinds compromised demonstrated the strategic importance of certain types of ubiquitous software, and the ability to generate widespread cybersecurity effects. To address this challenge and as a part of the Department of Energy’s response to the SolarWinds compromise, DOE’s Office of Cybersecurity, Energy Security, and Emergency Response (CESER) directed the National Laboratories to evolve the CyTRICS Prioritization Process methodology to encompass additional factors related to the strategic importance of digital components. CESER directed CyTRICS researchers to identify, characterize, and append strategic factors to the CyTRICS Prioritization Process to provide additional weight to these characteristics. National Laboratory expert researchers identified functionality, distribution, and platform characteristics for digital components in ICS and OT that they assessed would be likely targeted in strategic initial-access cyber attack. CyTRICS has termed these factors “ICS Beachhead Systems,” leveraging a definition first advanced by Schneider Electric, which is intended as a blanket term to encompass digital components, products, and systems in OT. This paper describes the ICS Beachhead Systems identified and the rationale for inclusion. As a next step in the research and refinement process, the National Laboratories will validate this initial set of characteristics against digital components evaluated by the CyTRICS program and current implementation of the CyTRICS Prioritization Process. After validation, CyTRICS researchers will then develop a scoring methodology to generate a quantitative score to assess the degree to which a digital component is characterized as an ICS Beachhead System. Finally, the National Laboratories will append this scoring to the existing CyTRICS Prioritization Process algorithm.

97 MATHEMATICS AND COMPUTING↗