Search NASA⌕ Search

SEARCH · Search NASA

Results for “User evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

A Pulse Generation Framework with Augmented Program-aware Basis Gates and Criticality Analysis

Near-term intermediate scale quantum (NISQ) de- vices are subject to considerable noise and short coherence time. Consequently, it is critical to minimize circuit execution latency. Traditionally, each basis gate of a transpiled circuit is decoded into a fixed episode of the device control pulses. Recently, people started to investigate merged pulse generation for customized gates through quantum optimal control (QOC). However, existing QOC approaches face the challenges of (i) restricted search space due to prohibitive compilation overhead; (ii) suboptimal end-to-end performance due to aggressive local optimization and falsely introduced dependency among the customized gates; (iii) inadequate adaptivity towards system calibration, which is critical for NISQ devices. In this work, we propose PAQOC, a novel QOC framework that can (i) automatically detect frequently encountered gate patterns in the logical circuit by modeling the problem as a subgraph mining process and reuse these patterns to enable much larger search space exploration (i.e., program aware); (ii) systemically construct customized gate-set based on the impact to the overall program latency (i.e., criticality-aware); and (iii) quickly adapt to system re-calibration thanks to the small-scale pattern-based gate generation (i.e., adaptivity-aware). PAQOC achieves a good tradeoff between circuit performance and compilation time, allowing fully automatic, single stop, ad- hoc customized pulse generation for more efficient execution of user programs on NISQ devices. Evaluations using fifteen applications show that PAQOC can achieve on average 1.95× speedup of the circuit latency and achieve on average 36.7% reduction in compilation overhead. With PAQOC, circuits can run faster with reduced noise, allowing deeper circuits to be tested within the coherence time of present NISQ platforms.

Chen, Yanhao↗
DOE OSTI2021

TangibleData: Interactive Data Visualization with Mid-Air Haptics

In this paper, we investigate the effects of mid-air haptics in interactive 3D data visualization. We build an interactive 3D data visualization tool that adapts hand gestures and mid-air haptics to provide tangible interaction in VR using ultrasound haptic feedback on 3D data visualization. We consider two types of 3D visualization datasets and provide different data encoding methods for haptic representations. Two user experiments are conducted to evaluate the effectiveness of our approach. The first experimental results show that adding a mid-air haptic modality can be beneficial regardless of noise conditions and useful for handling occlusion or discerning density and volume information. The second experiment results further show the strengths and weaknesses of direct touch and indirect touch modes. Our findings can shed light on designing and implementing a tangible interaction on 3D data visualization with mid-air haptic feedback.

Bhardwaj, Ayush↗
DOE OSTI2025

GreenThrift: Optimizing Carbon and Cost for Flexible Residential Loads

Reducing buildings’ carbon emissions is an important sustainability challenge. While scheduling flexible building loads has been previously used for a variety of grid and energy optimizations, carbon footprint reduction using such flexible loads poses new challenges since such methods need to balance both energy and carbon costs while also reducing user inconvenience from delaying such loads. This paper highlights the potential conflict between electricity prices and carbon emissions and the resulting trade-offs in carbon-aware and cost-aware load scheduling. To address this trade-off, we propose GreenThrift, a home automation system that leverages the scheduling capabilities of smart appliances and knowledge of future carbon intensity and cost to reduce both the carbon emissions and costs of flexible energy loads. At the heart of GreenThrift is an optimization technique that automatically computes schedules based on user configurations and preferences. We evaluate the effectiveness of GreenThrift using real-world carbon intensity data, electricity prices, and load traces from multiple locations and across different scenarios and objectives. Our results show that GreenThrift can replicate the offline optimal and retains 97% of the savings when optimizing the carbon emissions. Moreover, we show how GreenThrift can balance the conflict between carbon and cost and retain 95.3% and 85.5% of the potential carbon and cost savings, respectively.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Resilience Development For Electric Energy Delivery Systems

The Resilience Development for Electric Energy Delivery Systems (ResDEEDS) tool walks users through the process of evaluating electric energy delivery systems (EEDS) for resiliency. It implements the steps of the INL Resilience Framework for EEDS and provides automated tracking of resilience planning and suggestions for mitigating hazards.

Culler, MeganJ.↗
DOE OSTI2025

BioSTEAMDevelopmentGroup/BLocS

BioSTEAM Location-Specific Evaluation. This module allows BioSTEAM users to consider the impacts of economic and environmental parameters that vary by location. Current location-specific data includes income, property, fuel producer, and sales tax rates; feedstock prices (corn, corn stover, and sugarcane); electricity prices; natural gas prices; location capital cost factors (LCCFs), and tax incentives (available as of February 2020) for all 50 states in the US. Stewart et al. is the first paper to utilize BLocS to explore the influence of policy incentives and location-specific economic parameters on the financial viability of three different biorefineries.

Stewart, Dalton↗
DOE OSTI2024

Hydrogen Storage System Modeling: Public Access, Maintenance, and Enhancements

The overall vision of this project is to provide ownership and support for maintaining existing material-based hydrogen storage systems models. This includes making models accessible to the research community through a public web page and updating and enhancing storage systems models to support material developers in assessing their materials relative to DOE vehicle-level targets. Key elements for FY24: Continue to update and enhance existing models for broader application and user-friendliness. Develop tools to evaluate the performance of hydrogen storage materials developed under HyMARC activities or other fundamental hydrogen storage materials discovery research. Expand the application of current hydrogen storage models beyond light-duty vehicles to include medium-, heavy-duty, and mining vehicles and stationary application(s). Develop models for alternatives, such as LOHCs, to material-based systems (liquefied & gaseous H2) and compare for various mobile and stationary use cases.

ENERGY STORAGE,HYDROGEN↗
DOE OSTI2023

Unfolding Cross Sections: A Brief Introduction

Unfolding Cross Sections has been around forever, so there is nothing new in this report. I only authored this report because I fear that the current generation of ENDF data creators and users may not be familiar with this concept. This will be a brief introduction to unfolding, so I will only present one example, namely, ENDF/B-VIII U235. Let me stress that in selecting this example it was only because of the obvious importance of U235. In this selection I am not making any judgement as to the quality of this evaluation. Indeed, as I will keep reminding readers throughout this report, in my opinion the evaluators did an excellent job, and this evaluation meets the needs of many users. But it does violate ENDF-102 [1] that states MT=5 can be used for complex reactions at high energy. This evaluation uses MT=5 all the way down to the traditional ENDF lower energy limit at 1.0e-5 eV. There are no complex reactions at 1.0e-5 eV and this is certainly not high energy. To illustrate unfolding I will start from what I call their current U235 BEST physics evaluation and present what I call my BEST engineering evaluation, that better meets my needs – and more importantly the needs of the codes I use to process and use ENDF data. You, the reader, are free to select either – or neither – for your personal use. ENDF has been such a GREAT success because of the close bond between data producers and data users, who have supplied user feedback to improve the next generation of ENDF data. Here I am merely one of those users, and this is my feedback.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Non-Powered Dam Hydropower Development and Ranking Opportunity Tool

In pursuit of a net-zero-carbon emissions economy in the United States, non-powered dams (NPDs) represent a large opportunity to develop hydropower while leveraging existing infrastructure. With almost 600 NPD sites in the United States identified as having over 1 megawatt (MW) of potential capacity, only a small portion of the total potential capacity at these sites has been developed in recent years. , Conventional NPD retrofit feasibility analysis primarily focuses on the developer’s perspective but fails to consider the broader impacts of developing a dam, including on the neighboring communities. This tool, the Non-Powered Dam Hydropower Development and Ranking Opportunity Tool (NPD HYDRO), allows users to prioritize or rank NPD sites for future development based on user-defined priorities. Benefits can be evaluated in several categories: the grid, community, industry, and environment (referred to as the four impact scores in the tool as discussed in Section 2.2). In addition, the tool provides the user with a qualitative measure for the feasibility of adding energy storage during NPD conversion, specifically battery, hydrogen electrolysis, and pumped-storage hydropower (PSH). By taking a holistic approach to the potential range of benefits provided by NPD conversions with results tailored to the user’s priorities, NPD HYDRO provides the opportunity for national-level screening and enables users to focus on the sites that are most closely aligned with their interests.

13 HYDRO ENERGY↗
DOE OSTI2025

Raptor

Raptor is an efficient Python-based tool for predicting the formation and morphology of stochastic lack of fusion defects in metal AM processes. A major obstacle for the qualification and certification of additively manufactured parts in critical applications continues to be performance variability caused in part by porosity-related defects. High-fidelity process models that could predict these defect features are currently too computationally expensive for component-level analysis. To address this, Raptor employs a high-performance geometric method to model the dynamic melt pool rather than relying on computationally intensive thermal fluid dynamics. This allows Raptor to rapidly identify regions of unmelted material that correspond to lack of fusion pores. The efficiency of this approach significantly reduces the time and resources needed for generating 3D defect predictions, which enables users to conduct large-scale parameter studies and evaluate how process variations affect part quality. The framework offers operational flexibility; users can execute simulations through a simple command line interface or integrate core functions as a library within larger computational workflows. Simulation outputs include 3D porosity maps for visualization and tools for quantitative morphological analysis. These results are suitable for direct comparison with experimental characterization data from methods such as X-ray computed tomography and can be used for statistical process optimization.

Subraveti, Vamsi [Vanderbilt Univ., Nashville, TN ↗
DOE OSTI2025

Intelligent Manufacturing Support: Specialized LLMs for Composite Material Processing and Equipment Operation

Engineering educational curriculum and standards cover many material and manufacturing options. However, engineers and designers are often unfamiliar with certain composite materials or manufacturing techniques. Large language models (LLMs) could potentially bridge the gap. Their capacity to store and retrieve data from large databases provides them with a breadth of knowledge across disciplines. However, their generalized knowledge base can lack targeted, industry-specific knowledge. To this end, we present two LLM-based applications based on the GPT-4 architecture: (1) The Composites Guide: a system that provides expert knowledge on composites material and connects users with research and industry professionals who can provide additional support and (2) The Equipment Assistant: a system that provides guidance for manufacturing tool operation and material characterization. By combining the knowledge of general AI models with industry-specific knowledge, both applications are intended to provide more meaningful information for engineers. In this paper, we discuss the development of the applications and evaluate it through a benchmark and two informal user studies. The benchmark analysis uses the Rouge and Bertscore metrics to evaluate our models’ performance against GPT-4o. The results show that GPT-4o and the proposed models perform similarly or better on the ROUGE and BERTScore metrics. The two user studies supplement this quantitative evaluation by asking experts to provide qualitative and open-ended feedback about our model’s performance on a set of domain-specific questions. The results of both studies highlight a potential for more detailed and specific responses with the Composites Guide and the Equipment Assistant.

Kapoor, Gunnika [Oak Ridge National Laboratory (OR↗
DOE OSTI2025

Irradiation Testing of Ultrasonic Transducers

Ultrasonic technologies offer the potential for high accuracy and resolution in-pile measurement of numerous parameters, including geometry changes, temperature, crack initiation and growth, gas pressure and composition, and microstructural changes. Many Department of Energy-Office of Nuclear Energy (DOE-NE) programs are exploring the use of ultrasonic technologies to provide enhanced sensors for in-pile instrumentation during irradiation testing. For example, the ability of single, small diameter ultrasonic thermometers (UTs) to provide a temperature profile in candidate metallic and oxide fuel would provide much needed data for validating new fuel performance models. Other efforts include an ultrasonic technique to detect morphology changes (such as crack initiation and growth) and acoustic techniques to evaluate fission gas composition and pressure. These efforts are limited by the lack of existing knowledge of ultrasonic transducer material survivability under irradiation conditions. To address this need, the Pennsylvania State University (PSU) was awarded an Advanced Test Reactor National Scientific User Facility (ATR NSUF) project to evaluate promising magnetostrictive and piezoelectric transducer performance in the Massachusetts Institute of Technology Research Reactor (MITR) up to a fast fluence of at least 1021 n/cm2 (E> 0.1 MeV). This test will be an instrumented lead test; and real-time transducer performance data will be collected along with temperature and neutron and gamma flux data. By characterizing magnetostrictive and piezoelectric transducer survivability during irradiation, test results will enable the development of novel radiation tolerant ultrasonic sensors for use in Material and Test Reactors (MTRs). The current work bridges the gap between proven out-of-pile ultrasonic techniques and in-pile deployment of ultrasonic sensors by acquiring the data necessary to demonstrate the performance of ultrasonic transducers

Daw, J.↗
DOE OSTI2021

Cryo-EM model validation recommendations based on outcomes of the 2019 EMDataResource challenge

This paper describes outcomes of the 2019 Cryo-EM Model Challenge. The goals were to (1) assess the quality of models that can be produced from cryogenic electron microscopy (cryo-EM) maps using current modeling software, (2) evaluate reproducibility of modeling results from different software developers and users and (3) compare performance of current metrics used for model evaluation, particularly Fit-to-Map metrics, with focus on near-atomic resolution. Our findings demonstrate the relatively high accuracy and reproducibility of cryo-EM models derived by 13 participating teams from four benchmark maps, including three forming a resolution series (1.8 to 3.1 Å). The results permit specific recommendations to be made about validating near-atomic cryo-EM structures both in the context of individual experiments and structure data archives such as the Protein Data Bank. We recommend the adoption of multiple scoring parameters to provide full and objective annotation and assessment of the model, reflective of the observed cryo-EM map density.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

CVEVOLVE

CVEvolve is an agentic AI system for autonomous algorithm discovery for scientific data processing. It creates workflows where large language model agents freely set up and configure development environments and evaluation harnesses, develop and improve data processing algorithms with designed exploration-exploitation balancing mechanisms, log history and findings in a structured database, and run holdout testing to ensure algorithm generalizability. CVEvolve offers a zero-code interface and does not require users to provide structured data and evaluation scripts.

Cherukara, MatthewJoseph [Argonne National Laborat↗
DOE OSTI2023

Testing SOAR tools in use

Investigations within Security Operation Centers (SOCs) are tedious as they rely on manual efforts to query diverse data sources, overlay related logs, correlate the data into information, and then document results in a ticketing system. Security Orchestration, Automation, and Response (SOAR) tools are a relatively new technology that promise, with appropriate configuration, to collect, filter, and display needed diverse information; automate many of the common tasks that unnecessarily require SOC analysts’ time; facilitate SOC collaboration; and, in doing so, improve both efficiency and consistency of SOCs. There has been no prior research to test SOAR tools in practice; hence, understanding and evaluation of their effect is nascent and needed. Here, in this paper, we design and administer the first hands-on user study of SOAR tools, involving 24 participants and six commercial SOAR tools. Our contributions include the experimental design, itemizing six characteristics of SOAR tools, and a methodology for testing them. We describe configuration of a cyber range test environment, including network, user, and threat emulation; a full SOC tool suite; and creation of artifacts allowing multiple representative investigation scenarios to permit testing. We present the first research results on SOAR tools. Concisely, our findings are that: per-SOC SOAR configuration is extremely important; SOAR tools increase efficiency and reduce context switching, although with potentially decreased ticketing accuracy/completeness; user preference is slightly negatively correlated with their performance with the tool; internet dependence varies widely among SOAR tools; and balance of automation with assisting decision making is preferred by senior participants. We deliver a public user- and tool-anonymized and -obfuscated version of the data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Error-controlled Progressive Retrieval of Scientific Data under Derivable Quantities of Interest

The unprecedented amount of scientific data has introduced heavy pressure on the current data storage and transmission systems. Progressive compression has been proposed to mitigate this problem, which offers data access with on-demand precision. However, existing approaches only consider precision control on primary data, leaving uncertainties on the quantities of interest (QoIs) derived from it. In this work, we present a progressive data retrieval framework with guaranteed error control on derivable QoIs. Our contributions are three-fold. (1) We carefully derive the theories to strictly control QoI errors during progressive retrieval. Our theory is generic and can be applied to any QoIs that can be composited by the basis of derivable QoIs proved in the paper. (2) We design and develop a generic progressive retrieval framework based on the proposed theories, and optimize it by exploring feasible progressive representations. (3) We evaluate our framework using five real-world datasets with a diverse set of QoIs. Experiments demonstrate that our framework can faithfully respect any user-specified QoI error bounds in the evaluated applications. This leads to over 2.02× performance gain in data transfer tasks compared to transferring the primary data while guaranteeing a QoI error that is less than 1E-5.

Wu, Xuan↗
DOE OSTI2025

Comparative evaluation and selection of heat exchangers using multicriteria decision-making

Here, this study presents a well-structured method for comparing and selecting Heat Exchanger (HE) technologies for Integrated Energy Systems (IES). The decision to select a HE for a particular IES configuration can vary greatly depending not only on engineering requirements but also on customer’s specific demand. In other words, the HE selection for IES requires a multicriteria decision-making approach, taking into account diverse technical, economic, and safety aspects, as well as the relative priorities considered by energy users. This study employs a HE evaluation approach combining multicriteria decision-making techniques widely used in various industries: quality function deployment (QFD) and analytic hierarchy process (AHP) techniques. Of particular interest is the use of the proposed method to select a high-temperature HEs that couples advanced nuclear reactors and industrial processes. To build a practical basis for comparing HEs within the proposed framework, efforts were made to identify the various HEs requirements for IES purposes. In addition, leveraging the insights obtained from the literature review and the market survey of commercial HE suppliers, a knowledge base was built to facilitate the comparison of each requirement across various HE designs. Also, evaluation metrics were identified for HE requirements with robust rational to enhance the quality of decisions made throughout the proposed evaluation process. The evaluation procedure and knowledge base described in this study can provide a useful basis for those interested in screening the appropriate HE designs for various IES scenarios.

Analytic Hierarchy Process (AHP)↗
DOE OSTI2024

FECM/NETL CO 2 Saline Storage Cost Model (2024): User’s Manual

The U.S. Department of Energy's (DOE) Office of Fossil Energy and Carbon Management (FECM), in collaboration with the National Energy Technology Laboratory (NETL), has developed the FECM/NETL CO 2 Saline Storage Cost Model (CO2_S_COM). This Excel-based tool provides a comprehensive framework for estimating the costs and breakeven prices associated with storing carbon dioxide (CO 2 ) in deep saline formations. Designed from the perspective of a CO 2 storage site owner, the CO2_S_COM incorporates four integrated modules—project management, financial analysis, activity cost estimation, and geological evaluation—to deliver fast, robust, and actionable insights for evaluating project finances. This is the user's manual for CO2_S_COM. The model may be accessed at this link: FECM/NETL CO2 Saline Storage Cost Model CO2_S_COM 2024 (v4) - Submissions - EDX

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

WaterTAP3 (The Water Technoeconomic Assessment Pipe-Parity Platform)

The Water Technoeconomic Assessment Pipe-Parity Platform (WaterTAP3) was developed under the National Alliance for Water Innovation (NAWI) to facilitate consistent technoeconomic assessments of desalination treatment trains. The WaterTAP3 is an analytically robust modeling tool that can be used to evaluate water technology cost, energy, environmental, and resiliency tradeoffs across different water sources, sectors, and scales. The model simulates steady-state water treatment train performance and costs including flow and constituent mass balance across unit processes, based on source water conditions, configurations of treatment technologies, and system-level techno-economic assumptions. Users can build a new treatment train by connecting any number of unit processes, specific for their context and system, or selecting a train from the treatment train library. The model contains various technical and cost parameter options for a range of treatment processes and a library of influent water quality characteristics for a variety of source waters and case studies. Users can customize water quality parameters to evaluate the technology performance in their context. The model can be set up for different assessment needs including simulation, optimization, and uncertainty and sensitivity analyses. The results from WaterTAP3 can help identify trade-offs among the different system performance metrics, with insight on how particular technologies or systems promote pipe-parity. The flexibility and comprehensive scope of the tool makes it a promising solution to industry-wide water technoeconomic evaluations, leading to more informed water investment decisions and technologies. As a user-friendly, open-source platform, WaterTAP3 can be used by industry, academia, policymakers, planners, and those with or without extensive analytical experience.

Miara, Ariel↗