SEARCH · Search NASA

Results for “User Feedback”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Mitigative Strategies for Recovering From Large Language Model Trust Violations

In this study, we investigated strategies to address trust issues arising from errors in large language models (LLMs). The study examined the impact of confidence scores, system capability explanations, and user feedback on trust restoration post-error. 68 participants viewed the responses of an LLM to 20 general trivia questions, with an error introduced on the third trial. Each participant was presented with one mitigation strategy. Participants rated their overall trust in the model and the reliability of the answer. Results showed an immediate drop in trust after the error; however, there were no differences across the three strategies in trust recovery. All conditions had a logarithmic trend in trust recovery following error. Differences in overall trust were predicted by perceived reliability of the answer, suggesting that participants were evaluating results critically and using that to inform their trust in the model. Qualitative data supported this finding; participants expressed lasting distrust despite the LLM’s later accuracy. Results showcase the need to prioritize accuracy in LLM deployment, because early errors may irrevocably damage user trust calibration and later adoption.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

Agentic traffic intelligence: Augmented human-in-the-loop scenario generation for microscopic traffic simulation

Traditional microscopic traffic simulation generation often relies on static datasets and manual design, limiting its ability to simulate complex conditions easily. This paper presents a novel framework, Agentic Traffic Intelligence, which combines human approval large language models (LLMs), the Real-Twin tool, and multi-agent systems to perform realistic microscopic traffic simulation scenario generation. The proposed framework incorporates human-in-the-loop (HIL) control, retrieval-augmented generation (RAG), and multi-agent control mechanisms. HIL mechanisms are used to guide multiple LLMs focused on attributes for microscopic simulation generation and to improve the interpretability and transparency of LLM execution for users. RAG enhances context extraction by dynamically integrating external knowledge sources for traffic scenario generation foundations. A multi-agent architecture with supervisory control coordinates the interaction of simulation components, including traffic simulators, control logic, and calibration tools. This enables the synthesis of simulation-ready scenarios that reflect dynamic demand profiles and behavior controls. Furthermore, the framework fuses multisource traffic data with unstructured context and supports iterative refinement through interactive user feedback. Validated through microscopic simulation using Simulation of Urban Mobility, the generated scenarios demonstrate high-fidelity network generation with inflow and turn movement and behavioral calibration, offering a robust and efficient tool for stress-testing and optimizing urban mobility systems.

Hierarchical multi-agent control↗

DOE OSTI2025

SynopFrame: Multiscale time-dependent visual abstraction framework for analyzing DNA nanotechnology simulations

We present an open-source framework, SynopFrame, that allows DNA nanotechnology (DNA-nano) experts to analyze and understand molecular dynamics simulation trajectories of their designs. We use a multiscale multi-dimensional abstraction space, connect the representations to a projected conformational space plot of the structure’s temporal sequence, and thus enable experts to analyze the dynamics of their structural designs and, specifically, failure cases of the assembly. In addition, our time-dependent abstraction representation allows the biologists, for the first time in a smooth and structurally clear way, to identify and observe temporal transitions of a DNA-nano design from one configuration to another, and to highlight important periods of the simulation for further analysis. We realize SynopFrame as a dashboard of the different synchronized 3D spatial and 2D schematic visual representations, with a color overlay to show essential properties such as the status of hydrogen bonds. The linking of the spatial, schematic, and abstract views ensures that users can effectively analyze the high-frequency motion. We also categorize the status of the hydrogen bonds into a new format to allow us to color-encode it and overlay it on the representations. To demonstrate the utility of SynopFrame, we describe example usage scenarios and report user feedback.

Abstraction space↗

DOE OSTI2026

ToPolyAgent: AI agents for coarse-grained bead-spring topological polymer simulations

We introduce ToPolyAgent, a multi-agent AI framework for performing coarse-grained molecular dynamics (MD) simulations of topological polymers through natural language instructions. By integrating large language models (LLMs) with domain-specific computational tools, ToPolyAgent supports both interactive and autonomous simulation workflows across diverse polymer architectures, including linear, ring, brush, and star polymers, as well as dendrimers. The system consists of four LLM-powered agents: a Config Agent for generating initial polymer–solvent configurations, a Simulation Agent for executing LAMMPS-based MD simulations and conformational analyses, a Report Agent for compiling markdown reports, and a Workflow Agent for streamlined autonomous operations. Interactive mode incorporates user feedback loops for iterative refinements, while autonomous mode enables end-to-end task execution from detailed prompts. We demonstrate ToPolyAgent's versatility through case studies involving diverse polymer architectures under varying solvent conditions, thermostats, and simulation lengths. Furthermore, we highlight its potential as a research assistant by directing it to investigate the effect of interaction parameters on the linear polymer conformation, and the influence of grafting density on the persistence length of the brush polymer. By coupling natural language interfaces with rigorous simulation tools, ToPolyAgent lowers barriers to complex computational workflows and advances AI-driven materials discovery in polymer science. It lays the foundation for autonomous and extensible multi-agent scientific research ecosystems.

Ding, Lijie [Oak Ridge National Laboratory (ORNL),↗

DOE OSTI2020

Federal Energy Management Program’s Technical Resilience Navigator: Communications Plan

The Federal Energy Management Program is working to develop a standard, agency-neutral energy and water technical resilience navigator (TRN) to assist federal agencies with their resilience planning efforts, building on agency-expressed needs. The TRN Communications Plan defines how the project team and FEMP will generate awareness of the TRN, recruit validators, encourage its use across federal agencies, increase awareness among various audiences, and solicit user feedback on its usefulness including suggestions for improvement. In support of this purpose, the communications plan characterizes the key audiences, messages, communications channels, and activities needed to help ensure success. The role of communications is to define strategy and ensure leadership and consistency in messaging, writing, outreach, media relations, editing, and design related to the TRN.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2023

Recent Code Developments/Improvements to SAM Multi-dimensional Flow Model

The System Analysis Module (SAM) is under development at Argonne National Laboratory as a modern system-level modeling and simulation tool for advanced non-light water reactor safety analyses. In addition to its conventional one-dimensional flow network module, the multi-dimensional flow model of SAM offers significant benefits to its end-users, including the U.S. NRC, who uses it to develop reference models for advanced reactor concepts. This report provides a summary of the recent progress achieved under DOE-NE’s Nuclear Energy Advanced Modeling and Simulation program in the continuous code development and improvements of the SAM code, specifically its multi-dimensional flow model. The improvements include enhancements to the physical model, code usability, addressing user feedback, and compliance with the SQA program standards that aim to enhance and maintain the quality of the software.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2023

Molten Salt Reactor Experiment Simulation using Shift/Griffin

The Department of Energy (DOE)’s NEAMS focuses its efforts on the development of advanced modeling and simulation (M&S) tools for light-water reactors (LWRs) and non–LWRs (i.e., molten salt reactors, high-temperature gas reactors, microreactors, and fast reactors). In the previous fiscal year, the Multiphysics Applications Driver Technical Area funded molten salt reactor (MSR) M&S at Oak Ridge National Laboratory (ORNL) to generate multigroup macroscopic cross sections with Shift for a MSRE 2D lattice model in Griffin. In addition, Shift’s capability to calculate gamma dose rates from activated components in the primary exchangers in a molten salt breeder reactor was also demonstrated. In fiscal year 2023, ORNL generated multigroup macroscopic cross sections using Shift for a 3D MSRE core model. MSRE depletion calculations using Griffin were also demonstrated in this fiscal year. For the depletion calculation, one-group microscopic cross sections for the 3D MSRE core were generated using Shift, and the decay transmutation library from ORIGEN was converted to an ISOXML file, which is required as input in Griffin. Several Monte Carlo codes, such as OpenMC and Serpent, were also used to benchmark and supplement multigroup cross sections generated by Shift. Multigroup libraries were generated with 8 and 20 group structures, and the study found the 8-group structure to be more accurate when comparing Griffin results to continuous energy (CE) Monte Carlo results. The average flux from CE Shift calculations is up to ~6% higher than the CE Serpent calculations because of different values applied for the energy released per fission (κ values). The average flux in the fuel salt calculated by Griffin using cross sections generated with Shift agrees well with the reference CE Shift solution; the same is valid for the corresponding Serpent results. The maximum relative error is ~6% and ~2% compared to the CE Shift and Serpent reference solutions, respectively. Meanwhile, the average flux calculated by Griffin in the graphite moderator shows a higher difference in the thermal range when compared to both reference Monte Carlo solutions; this result suggests a need for improvement in cross section generation for the graphite moderator in the thermal range in both Monte Carlo codes. Griffin depletion calculations using cross sections from Shift and Serpent were performed and compared against ORIGEN calculations, and the nuclide densities calculated by Griffin were found to be generally in agreement with those of ORIGEN. Because a different approach was taken to calculate the energy released per fission ( κ values) in Shift and Serpent, a difference in nuclide densities from differences in the average flux was observed between Griffin using Serpent and Shift cross sections. Griffin calculations with Shift cross sections produced higher average flux in the salt than with Serpent cross sections, leading to higher consumption of 235 U and higher production of 135 Xe. For time-dependent depletion calculations, cross sections were generated with Serpent, and Griffin’s results using these cross sections were compared to CE Serpent depletion results, demonstrating good agreement. The average difference in keff between Serpent and Griffin as a function of burnup is about 155 pcm. Similarly, good agreement with small differences up to ~0.5% was also noticed in the nuclide density of 235 U and 135 Xe. More details regarding the methodologies invoked to generate the cross section to make code-to-code comparisons are discussed further in this report. User feedback on Griffin and Shift capabilities that will enhance these calculations is provided in this report for future consideration. The work performed this fiscal year can be extended further for multiphysics coupling of Griffin-Pronghorn/SAM with Mole to study precursor flow and salt chemistry.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2025

Grain2Mesh: Mesh Generation for Grain-Scale Nonlinear Elasticity Modeling

The nonlinear hysteretic behavior of rocks under cyclic loading is a crucial area of study in geomechanics. The macroscopic response of a variety of materials has been found to be contingent upon the behavior of the micro-scale structure. This project aims to develop a functional and maintainable software package for generating a multi-phase numerical mesh and accompanying simulation files for finite element modeling used in computational mechanics solvers. Meshes generated from images often lack key preprocessing that reduces noise and prevents mesh element distortion that can increase computational cost. By incorporating user feedback throughout, grain2mesh ensures a high-fidelity mesh that can be used to model grain-scale interactions such as shearing, crack propagation, and interfacial material contrast. Scientific applications of this software include material fracturing, stress-strain analysis for natural and engineered materials, and nonlinear meso-scale analysis.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Web-Based Tools for Data-Informed Remedy Optimization: Software Theory and User Guide

This report documents the development and application of two web-based decision-support tools for pump-and-treat (P&T) groundwater remediation systems: PTOLEMY (Pump-and-Treat Optimized Location Evaluation to Maximize Yields) and OPTIMA (Optimization for Pump-and-Treat Implementation, Management, & Assessment). These tools enhance remedy design and management by leveraging advanced computational methods – specifically deep learning and multi-objective optimization – within a user-friendly platform. By integrating data-driven models with established hydrogeological knowledge, PTOLEMY and OPTIMA enable more efficient evaluation of well placement and operational strategies, helping site managers balance multiple remediation objectives under complex conditions. Both tools are implemented as modules within the SOCRATES (Suite Of Comprehensive Rapid Analysis Tools for Environmental Sites) web platform, which provides data access, visualization, and analytics to support remedy optimization across sites in the U.S. Department of Energy Office of Environmental Management complex. PTOLEMY is a rapid screening module designed to identify promising locations for new extraction wells. It employs a multi-channel three-dimensional convolutional neural network (MC3D-CNN) trained on high-fidelity simulation data to predict the relative performance (in terms of contaminant mass recovery) of potential well sites. Through an interactive web interface, PTOLEMY visualizes the probability of high performance across a site, highlighting areas where an extraction well is likely to yield above-threshold contaminant removal over a multi-year period. PTOLEMY’s map-based displays and exportable results support transparent communication of screening analyses. By focusing attention on the most favorable candidate locations, the tool augments traditional engineering judgment and physics-based modeling, providing a data informed basis for subsequent detailed evaluations. OPTIMA is a multi objective optimization module designed to find wellfield layouts and operating schedules that meet various cleanup goals. It quickly evaluates thousands of candidate setups – combinations of well locations, timing, and rates – and returns a small set of best trade-off options for comparison. At its core, OPTIMA uses a U-Net-based surrogate model – a deep-learning emulator of a groundwater flow and transport simulator – to dramatically accelerate scenario evaluations. Coupling this fast surrogate with the NSGA-II (Non-dominated Sorting Genetic Algorithm II) evolutionary algorithm, OPTIMA explores a wide decision space of well locations and schedules to identify Pareto-optimal solutions that trade off key objectives (e.g., minimizing cleanup time, maximizing contaminant mass removal, and minimizing plume extent). The tool outputs a family of optimal configurations and visualizes their trade-offs (Pareto frontiers of cleanup metrics and maps of optimized well placements). Site managers can use these results to understand the range of viable strategies and to select candidate designs for more detailed verification. OPTIMA is currently under active development and not yet fully released; this guide provides early documentation to support planning and gather user feedback.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Synthesis of ARM User Facility Surface Rainfall Datasets to Construct a Best Estimate Value Added Product (PrecipBE)

Surface precipitation measurements are essential for Earth system model (ESM) evaluation and understanding cloud processes. An ever-growing need for robust, temporally evolving, and easy-to-use statistical datasets provides motivation for a baseline ground-based precipitation properties data product. The U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility operates an extensive suite of precipitation instruments with various sensitivities and operating mechanisms, which render the decision of which instrument to use based on one or more fixed thresholds challenging and prone to errors and bias. Using a long-term instrument inter-comparison from a unique per-precipitation event perspective, rather than instantaneous sample comparison, we demonstrate that ARM rainfall-measuring instruments are generally consistent with each other at the statistical level. Inter-instrument deviations at the single event level can be large, especially for specific rainfall event properties such as maximum precipitation rates. A machine-learning (ML) analysis using a random forest regressor indicates that in some cases, depending on instrument, local site climatology, and/or specific deployment configuration, certain atmospheric state variables influence the measured quantities in an unpredictable manner. Thus, a-priori weighting of different instruments does not necessarily lead to more accurate and less biased synthesis of instrument data. These results motivate the design of the ARM precipitation best-estimate (PrecipBE) value-added product, which incorporates all valid precipitation data while considering data quality and other instrument limitations. PrecipBE consists of time series and tabular statistics datasets in an easy-to-use and insightful per-precipitation event format. It provides a large set of precipitation event properties supplemented with ancillary data from ARM datasets that correspond to the detected precipitation events. We describe the PrecipBE algorithm and demonstrate its use via the examination of a single-day output as well as a long-term trend analysis of precipitation events at the ARM Southern Great Plains (SGP) site, covering more than 30 years of data. The trend analysis tentatively suggests a long-term temporal tendency for mainly shorter and less intense precipitation events at the SGP site, but a long-term increase in annual rainfall by more than 36 mm (5 %) per decade. This rainfall trend is catalyzed primarily by more extreme event properties of relatively rare, intense precipitation events, with event total and 1 min maximum precipitation rate at a 1 year timeframe increasing up to 5 mm and 9 mm h −1 (several percent) per decade, respectively. While the currently available PrecipBE datasets (at https://adc.arm.gov/discovery/, last access: 8 December 2025) cover rainfall from multiple ARM deployments up to March 2025, PrecipBE is planned to be expanded to include solid-phase precipitation and will soon become an operational product with a several-day lag from real-time. We invite the ARM user community to leverage this new product and welcome user feedback to further enhance the dataset.

Silber, Israel [Pacific Northwest National Laborat↗

NASA NTRS1974

Development of techniques to enhance man/machine communication

A four-state random stimulus generator, considered to function as an ESP teaching machine was used to investigate an approach to facilitating interactions between man and machines. A subject tries to guess in which of four states the machine is. The machine offers the user feedback and reinforcement as to the correctness of his choice. Using this machine, 148 volunteer subjects were screened under various protocols. Several whose learning slope and/or mean score departed significantly from chance expectation were identified. Direct physiological evidence of perception of remote stimuli not presented to any known sense of the percipient using electroencephalographic (EEG) output when a light was flashed in a distant room was also studied.

Targ, R.↗

NASA NTRS1990

Management and display of four-dimensional environmental data sets using McIDAS

Over the past four years, great strides have been made in the areas of data management and display of 4-D meteorological data sets. A survey was conducted of available and planned 4-D meteorological data sources. The data types were evaluated for their impact on the data management and display system. The requirements were analyzed for data base management generated by the 4-D data display system. The suitability of the existing data base management procedures and file structure were evaluated in light of the new requirements. Where needed, new data base management tools and file procedures were designed and implemented. The quality of the basic 4-D data sets was assured. The interpolation and extrapolation techniques of the 4-D data were investigated. The 4-D data from various sources were combined to make a uniform and consistent data set for display purposes. Data display software was designed to create abstract line graphic 3-D displays. Realistic shaded 3-D displays were created. Animation routines for these displays were developed in order to produce a dynamic 4-D presentation. A prototype dynamic color stereo workstation was implemented. A computer functional design specification was produced based on interactive studies and user feedback.

Hibbard, William L.↗

NASA NTRS1990

Interactive numerical flow visualization using stream surfaces

Particle traces and ribbons are often used to depict the structure of three-dimensional flowfields, but images produced using these models can be ambiguous. Stream surfaces offer a more visually intuitive method for the depiction of flowfields, but interactive response is needed to allow the user to place surfaces which reveal the essential features of a given flowfield. FLORA, a software package which supports the interactive calculation and display of stream surfaces on silicon graphics workstations, is described. Alternative methods for the integration of particle traces are examined, and calculation through computational space is found to provide rapid results with accuracy adequate for most purposes. Rapid calculation of traces is teamed with progressive refinement of appoximated surfaces. An initial approximation provides immediate user feedback, and subsequent improvement of the surface ensures that the final image is an accurate representation of the flowfield.

Hultquist, J. P. M.↗

NASA NTRS1992

Evolution of a NASTRAN trainer

The development is traced of a NASTRAN training system. The design and organization of the program is examined, including the static and dynamic modules. A discussion of how user feedback, in the form of questionnaire responses, was used to evaluate and improve the trainer is included. The trainer was used by a number of engineers, who found it to be a versatile low cost tool. It is particularly helpful in bridging the gap from theory to practical application of the finite element method for structural analysis. The program, along with documentation, is available through COSMIC.

Grooms, H. R.↗

NASA NTRS1992

Development of a task analysis tool to facilitate user interface design

A good user interface is one that facilitates the user in carrying out his task. Such interfaces are difficult and costly to produce. The most important aspect in producing a good interface is the ability to communicate to the software designers what the user's task is. The Task Analysis Tool is a system for cooperative task analysis and specification of the user interface requirements. This tool is intended to serve as a guide to development of initial prototypes for user feedback.

Scholtz, Jean C.↗

NASA NTRS1992

Technology transfer within the NASA Goddard Space Flight Center

Viewgraphs on technology transfer within the NASA Goddard Space Flight Center presented to Civil Space Technology Development workshop on technology transfer and effectiveness are provided. Topics covered include: obstacles to technology transfer; technology transfer improvement program at GSFC: communication between technology developers and users; and user feedback to technologists.

Plotkin, Henry H.↗

NASA NTRS1993

The computer integrated documentation project: A merge of hypermedia and AI techniques

To generate intelligent indexing that allows context-sensitive information retrieval, a system must be able to acquire knowledge directly through interaction with users. In this paper, we present the architecture for CID (Computer Integrated Documentation). CID is a system that enables integration of various technical documents in a hypertext framework and includes an intelligent browsing system that incorporates indexing in context. CID's knowledge-based indexing mechanism allows case based knowledge acquisition by experimentation. It utilizes on-line user information requirements and suggestions either to reinforce current indexing in case of success or to generate new knowledge in case of failure. This allows CID's intelligent interface system to provide helpful responses, based on previous experience (user feedback). We describe CID's current capabilities and provide an overview of our plans for extending the system.

Mathe, Nathalie↗

NASA NTRS1990

Automated Software Development Workstation (ASDW)

Software development is a serious bottleneck in the construction of complex automated systems. An increase of the reuse of software designs and components has been viewed as a way to relieve this bottleneck. One approach to achieving software reusability is through the development and use of software parts composition systems. A software parts composition system is a software development environment comprised of a parts description language for modeling parts and their interfaces, a catalog of existing parts, a composition editor that aids a user in the specification of a new application from existing parts, and a code generator that takes a specification and generates an implementation of a new application in a target language. The Automated Software Development Workstation (ASDW) is an expert system shell that provides the capabilities required to develop and manipulate these software parts composition systems. The ASDW is now in Beta testing at the Johnson Space Center. Future work centers on responding to user feedback for capability and usability enhancement, expanding the scope of the software lifecycle that is covered, and in providing solutions to handling very large libraries of reusable components.

Fridge, Ernie↗