Search NASA⌕ Search

SEARCH · Search NASA

Results for “User evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Host Onboarding Tool (HObT) v1.0.0

The Host OnBoarding Tool (Hobt) is a publicly accessible, web-based software designed to organize and share information about microbial hosts under development at the Agile BioFoundry (ABF). It streamlines the assessment, tracking, and sharing of information related to microbial host development and provides a centralized platform where users can rapidly evaluate hosts' readiness for various bio processes. HObT leverages the Tier System, a standardized host development framework that organizes and assesses microbial hosts based on their readiness for biomanufacturing. Each tier outlines key targets—including genetic tools, growth conditions, omics data, and predictive models—needed to transform new or emerging microbes into established production platforms. By applying clear criteria for advancement, the Tier System helps users quickly evaluate each organism's current development status, identify gaps in available knowledge or tools, and prioritize future strain improvement efforts. Through its user-friendly interface, HObT encourages contributions of new data and insights from researchers, fostering collaboration and accelerating host development. By providing structured guidance for microbial strain advancement, HObT and the Tier System support more systematic, rapid, and cost-effective development of non-traditional microbial hosts, ultimately enhancing the efficiency and impact of biomanufacturing research and applications.

Plahar, Hector [Lawrence Berkeley National Laborat↗
DOE OSTI2026

Signal Whisperers: Enhancing Wireless Reception Using DRL-Guided Reflector Arrays

This paper presents a multi-agent reinforcement learning (MARL) approach for controlling adjustable metallic reflector arrays to enhance wireless signal reception in non-line-of-sight (NLOS) scenarios. Unlike conventional reconfigurable intelligent surfaces (RIS) that require complex channel estimation, our system employs a centralized training with decentralized execution (CTDE) paradigm where individual agents corresponding to reflector segments autonomously optimize reflector element orientation in three-dimensional space using spatial intelligence based on user location information. Through extensive ray-tracing simulations with dynamic user mobility, the proposed multi-agent beam-focusing framework demonstrates substantial performance improvements over single-agent reinforcement learning baselines, while maintaining rapid adaptation to user movement within one simulation step. Comprehensive evaluation across varying user densities and reflector configurations validates system scalability and robustness. The results demonstrate the potential of learning-based approaches for adaptive wireless propagation control.

deep reinforcement learning↗
DOE OSTI2026

Addressing the split incentive challenge for rooftop solar PV and battery energy storage in multifamily rental buildings (CRADA 638 Final Report)

This project advances the understanding of how roof solar PV systems and battery energy storage systems (BESS) can be effectively deployed in multifamily residential buildings, a sector that has historically faced barriers due to misaligned incentives between landlords and tenants. By leveraging high-resolution building stock data and simulation tools, the research demonstrates how energy consumption patterns vary across building types, climates, and occupant characteristics, and how these variations influence the optimal sizing and operation of distributed energy resources. A key contribution is the development of a publicly accessible, web-based tool named RESIDE (Residential Energy Systems & Infrastructure Data Evaluation) that allows users to explore building energy use and evaluate solar and battery configurations without requiring specialized expertise. This significantly lowers the barrier to entry for stakeholders such as property owners, utilities, and policymakers. From a technical perspective, the project shows that integrating rooftop solar PV with battery energy storage can substantially reduce electricity costs and peak demand through strategies such as energy arbitrage and peak shaving. The modeling framework incorporates real-world constraints, including time-of-use electricity pricing and battery degradation, providing realistic and actionable insights. Economically, the results indicate that properly sized systems can deliver meaningful cost savings, improving the feasibility of energy investments in multifamily housing. More broadly, the project benefits the public by supporting the transition to affordable and reliable energy, particularly in rental multifamily housing where adoption has traditionally lagged.

14 SOLAR ENERGY↗
DOE OSTI2020

How Do Visual Explanations Foster End Users' Appropriate Trust in Machine Learning?

We investigated the effects of different visual explanations on users' trust in machine learning classification. We proposed three forms of visual explanations of a classification based on identifying relevant training instances. We conducted a user study to evaluate these visual explanations as well as a no explanation condition. We measured users' trust of a classifier, quantified the effects of these three forms of explanations, and assessed the changes in users' trust. We found that participants trust a classifier appropriately when an explanation is available. The combination of human, classification algorithm and understandable explanation makes better decisions than the classifier and human alone.This work advances the state-of-the-art closer to building trust-able machine learning models and informs the design and appropriate use of automated systems.

Yang, Fumeng↗
DOE OSTI2021

REopt Lite User Manual

REopt Lite evaluates the economic viability of grid-connected solar photovoltaics, wind, combined heat and power, and electric and thermal storage at commercial and small industrial sites. It allows building owners to identify the system sizes and dispatch strategies that minimize the site’s life cycle cost of energy. REopt Lite also estimates the amount of time on-site generation and storage can sustain the site's critical load during a grid outage and allows the user the choice of optimizing for energy resilience. It is primarily used to inform project development decisions and to support research on the factors that drive project feasibility for market development and policy analysis. It is available through a web interface, application programing interface, and open-source code. This user manual provides an overview of the model, including its capabilities and typical applications; inputs and outputs; economic calculations; technology descriptions; and model parameters, variables, and equations. The model is highly flexible and is continually evolving to meet the needs of each analysis. Therefore, this report is not an exhaustive description of all capabilities, but rather a summary of the core components of the model.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Evaluating downscaled products with expected hydroclimatic co-variances

Abstract. There has been widespread adoption of downscaled products amongst practitioners and stakeholders to ascertain risk from climate hazards at the local scale (e.g., ∼ 5 km resolution). Such products must nevertheless be consistent with physical laws to be credible and of value to users. Here we evaluate statistically and dynamically downscaled products by examining local co-evolution of downscaled temperature and precipitation during convective and frontal precipitation events (two mechanisms testable with just temperature and precipitation). We find that two widely used statistical downscaling techniques (Localized Constructed Analogs version 2, LOCA2, and Seasonal Trends and Analysis of Residuals Empirical Statistical Downscaling Model, STAR-ESDM) generally preserve expected co-variances during convective precipitation events over the historical and future projected intervals as compared to European Centre for Medium-Range Weather Forecasts Reanalysis v5 (ERA5) and two observation-based data products (Livneh and nClimGrid-Daily). However, both techniques dampen future intensification of frontal precipitation that is otherwise robustly captured in global climate models (i.e., prior to downscaling) and with process-based dynamical downscaling across five different regional climate models. In the case of LOCA2, this leads to appreciable underestimation of future frontal precipitation event intensity. This study is one of the first to quantify a likely ramification of the stationarity assumption underlying statistical downscaling methods and identify a phenomenon where projections of future change diverge depending on data production method employed. Finally, our work proposes expected co-variances during convective and frontal precipitation as useful evaluation diagnostics that can be universally applied to a wide range of statistically downscaled products.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Visual feedback and guided balance training in an immersive virtual reality environment for lower extremity rehabilitation

Balance training is essential for physical rehabilitation procedures, as it can improve functional mobility and enhance cognitive coordination. However, conventional balance training methods may have limitations in terms of motivation, real-time objective feedback, and personalization, which a virtual reality (VR) setup may provide a better alternative. In this work, we present an immersive VR training environment for lower extremity balance rehabilitation with real-time guidance and feedback. The VR training environment immerses the user in a 3D ice rink model where a virtual coach (agent) leads them through a series of balance poses, and the user controls a trainee avatar with their own movements. Here we developed two coaching styles: positive-reinforcement and autonomous-supportive, and two viewpoints of the trainee avatar: first-person and third-person. The proposed environment was evaluated in a user study with healthy, non-clinical participants (n = 16, 24.4 ± 5.7 years old, 9 females). Our results show that participants showed stronger performance in the positive-reinforcement style compared to the autonomous-supportive style. Additionally, in the third-person viewpoint, the participants exhibited more stability in the positive-reinforcement style compared to the autonomous-supportive style. For viewpoint, participants exhibited stronger performance in the first-person viewpoint compared to third-person in the autonomous-supportive style, while they were comparable in the positive-reinforcement style. We observed no significant effects on the foot height and number of mistakes. Furthermore, we report the analysis of user performance with balance training poses and subjective measures based on questionnaires to assess the user experience, usability, and task load. The proposed VR balance training could offer an interactive, adaptive, and engaging environment and open new potential research directions for lower extremity rehabilitation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

A Visual Designer of Layer‐wise Relevance Propagation Models

Abstract Layer‐wise Relevance Propagation (LRP) is an emerging and widely‐used method for interpreting the prediction results of convolutional neural networks (CNN). LRP developers often select and employ different relevance backpropagation rules and parameters, to compute relevance scores on input images. However, there exists no obvious solution to define a “best” LRP model. A satisfied model is highly reliant on pertinent images and designers' goals. We develop a visual model designer, named as VisLRPDesigner, to overcome the challenges in the design and use of LRP models. Various LRP rules are unified into an integrated framework with an intuitive workflow of parameter setup. VisLRPDesigner thus allows users to interactively configure and compare LRP models. It also facilitates relevance‐based visual analysis with two important functions: relevance‐based pixel flipping and neuron ablation. Several use cases illustrate the benefits of VisLRPDesigner. The usability and limitation of the visual designer is evaluated by LRP users.

Huang, Xinyi↗
DOE OSTI2021

A Visual Designer of Layer-wise Relevance Propagation Models

Layer-wise Relevance Propagation (LRP) is an emerging and widely-used method for interpreting the prediction results of convolutional neural networks (CNN). LRP developers often select and employ different relevance backpropagation rules and parameters, to compute relevance scores on input images. However, there exists no obvious solution to define a "best" LRP model. A satisfied model is highly reliant on pertinent images and designers' goals. We develop a visual model designer, named as VisLRPDesigner, to overcome the challenges in the design and use of LRP models. Various LRP rules are unified into an integrated framework with an intuitive workflow of parameter setup. VisLRPDesigner thus allows users to interactively configure and compare LRP models. It also facilitates relevance-based visual analysis with two important functions: relevance-based pixel flipping and neuron ablation. Several use cases illustrate the benefits of VisLRPDesigner. The usability and limitation of the visual designer is evaluated by LRP users.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

From Simple Labels to Time-Use Integrations: Supporting the Spectrum of Qualitative Travel Behavior Data

In transportation research, applications of travel behavior data collection are context-specific and require different types of qualitative inputs. These inputs can be viewed as spanning a spectrum of user burden and data quality, from simple trip labels to complex time-use surveys. However, each currently active smartphone-based travel diary platform appears to only support one type of qualitative input, and the effort required for customization is unclear. In this paper, we characterize the spectrum by defining four canonical use cases: (i) trip labels, (ii) trip questionnaire, (iii) counterfactual trips, and (iv) time-use surveys. We then outline a mechanism for supporting configurable user inputs on the same underlying smartphone-based sensing mechanism and demonstrate that it can support all the use cases without any code changes. We further demonstrate that the flexible data model that underpins this mechanism can enable real-time monitoring and analysis. Finally, we evaluate per-user data collection and engagement metrics for large-scale deployments of three canonical use cases, spanning 10 programs, 435 users, and 251,041 trips, and a maximum duration of 800 days. Future efforts may support additional use cases through an expanded configuration and provide greater insight into user engagement. We hope that these insights enable the research community to look at qualitative inputs through a new lens and experiment with novel use cases to fill in the spectrum.

ADVANCED PROPULSION SYSTEMS,POWER TRANSMISSION AND↗
DOE OSTI2020

Guide for Joint Participation in a DOE Complex Wide SAVY-4000 Surveillance Program

This document describes LANL Storage Program best practices when working with other User Sites to implement DOE M441.1-1 Manual requirements through the use of the SAVY nuclear material packaging system. It is a Manual directive for Field Element Managers to review and approve the SAVY-4000 container series design (with supporting technical basis) as a packaging system for use at their respective sites. This review and approval incorporates an evaluation of the User Site methodology for SAVY surveillance and the process for documenting its nuclear materials storage program. This document aims to assist the Field Element Mangers and User Sites in the processes necessary to credit LANL SAVY surveillance for key elements of the User Site surveillance plan.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

RAG for FLAG: AI Assistance for a Physics Code

Artificial intelligence (AI) has quickly become an important tool in scientific research, where significant efforts are underway to develop tools that will expedite the research process. One area of particular impact is scientific software, which can be particularly complex, and therefore time consuming to learn and use effectively. AI assistants are increasingly helping to streamline the process by performing tasks such as interactively answering user questions or suggesting solutions. Los Alamos National Laboratory (LANL) develops several advanced scientific codes, such as FLAG, which can be used to run multiphysics simulations. With this study, our goal was to develop an AI assistant for FLAG that could help make the process of understanding the software and running physics simulations more efficient. To develop an AI assistant for FLAG, we used a method called retrieval-augmented generation (RAG), which is a technique that uses information from relevant data sources to enhance the accuracy of large language models (LLMs). We used the FLAG user manual and other FLAG documentation as the knowledge base for the RAG system. When a user provides a query, RAG retrieves relevant sections from the knowledge base in response, then uses those excerpts to generate grounded and contextually rich answers. We found that our AI assistant was able to provide context aware answers and source references to user queries. To evaluate performance, we developed a set of 40 benchmark questions and compared the accuracy of the responses to those of two standard LLMs without retrieval. Our AI assistant significantly outperformed the standard LLMs at answering FLAG-related questions, with an 82.5% accuracy rate, compared to 47.5% for both of the standard LLMs. This has the potential to make the process of learning and using FLAG much easier, especially for new users. Ultimately, it supports LANL’s broader mission by empowering scientists and engineers to focus more on discovery and analysis rather than on navigating complex software systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Thinking Beyond the Default User: The Impact of Gender, Stereotypes, and Modality on Interpretation of User Needs

Throughout the mechanical design process, designers, the majority of whom are men, often fail to consider the needs of women, resulting in consequences ranging from inconvenience to increased risk of serious injury or death. Although these biases are well studied in other fields of research, the mechanical design field lacks formal investigation into this phenomenon. In this study, engineering students (n = 301) took a survey in which they read a Persona describing a student makerspace user and a Walkthrough describing the user’s interaction with the makerspace while completing a project. During the Walkthrough, the user encountered various obstacles or Pain Points. Participants were asked to recall and evaluate the Pain Points that the user encountered and then evaluated their perceptions of the makerspace and user. Furthermore, the independent variables under investigation were the gender of the user Persona (woman, gender-neutral, or man), the Walkthrough room case (crafting or woodworking makerspace), and the modality of the Persona and Walkthrough (text- or audio-based). Results showed that participants from the Text-based modality were better able to recall Pain Points compared to participants from the Audio-based modality. Pain Points were assessed as more severe when they impacted women users, potentially stemming from protective paternalism. In addition to finding that the gender of a user impacted the way a task environment was perceived, results confirmed the presence of androcentrism, or “default man” assumptions, in the way designers view end users of unknown gender. Promisingly, providing user Persona information in an audio modality significantly reduced this bias compared to text-based modalities, indicating that providing richer detail in user personas has the capability to reduce gender bias in designers.

cognitive-based design↗
DOE OSTI2024

Coupling thermal energy storage with a thermally anisotropic building envelope for building demand-side management across various US climate conditions

Here, the thermally anisotropic building envelope (TABE) is a novel active building envelope that enhances energy efficiency and thermal comfort in buildings by transferring heat and cold between building envelopes and hydronic loops. When coupled with thermal energy storage (TES) units, the TABE + TES enables the storage of both heat and cold energy captured by the TABE roof or exterior walls. This stored energy can be later released by the TABE floor for indoor heating and cooling, benefiting both the grid and the end user. This paper evaluates the merits of TABE + TES for building demand-side management across various US climate conditions, focusing on peak load shaving, annual energy savings, and cost savings under time-of-use (TOU) electric rate schedules. Simulations were conducted by integrating time-of-day–informed, rule-based control strategies in MATLAB, TABE components and TES units in COMSOL Multiphysics, and whole-building energy analysis in EnergyPlus. A case study using the US Department of Energy’s prototype single-family detached house model in Birmingham, Alabama; Los Angeles, California; Oak Ridge, Tennessee; and Denver, Colorado, showed that the TABE + TES system achieved (1) 70 % peak load shaving in Los Angeles and Denver and 20 % in Birmingham and Oak Ridge; (2) significant peak electricity savings of 351–497 kWh, reducing peak energy consumption by 38 %–78 %; and (3) annual heating cost savings of 0.79 $\$$/m2–1.17 $\$$/m 2 and cooling cost savings of 0.60 $\$$/m 2 –1.17 $\$$/m 2 using a normal utility rate or low-TOU rate. The benefits of employing the TABE + TES system are even more significant under high TOU rates.

25 ENERGY STORAGE↗
DOE OSTI2020

Additive and Subtractive Manufacturing Augmented Reality Interface (ASMARI)

Industry 4.0 represents the next evolution of industrial technology. Some of the key characteristics of Industry 4.0 include augmented reality and additive manufacturing. In support of this evolution, researchers at Oak Ridge National Lab created a prototype augmented reality (AR) interface, ASMARI. This prototype acts as a common interface for both industrial additive and subtractive machines. Additionally, in the changing industrial workspace of Industry 4.0, the role of humans will also change. This interface focuses on increasing productivity and situational awareness, while providing new interaction modalities for interacting with hardware. The prototype was also evaluated by multiple users who provided positive feedback on the system. Ultimately, the prototype represents a first step towards significant integration between augmented reality and additive manufacturing.

Borish, Michael↗
DOE OSTI2022

DRAS: Deep Reinforcement Learning for Cluster Scheduling in High Performance Computing

Cluster schedulers are crucial in high-performance computing (HPC). They determine when and which user jobs should be allocated to available system resources. Existing cluster scheduling heuristics are developed by human experts based on their experience with specific HPC systems and workloads. However, the increasing complexity of computing systems and the highly dynamic nature of application workloads have placed tremendous burden on manually designed and tuned scheduling heuristics. More aggressive optimization and automation are needed for cluster scheduling in HPC. In this work, we present an automated HPC scheduling agent named DRAS (Deep Reinforcement Agent for Scheduling) by leveraging deep reinforcement learning. DRAS is built on a hierarchical neural network incorporating special HPC scheduling features such as resource reservation and backfilling. An efficient training strategy is presented to enable DRAS to rapidly learn the target environment. Once being provided a specific scheduling objective given by the system manager, DRAS automatically learns to improve its policy through interaction with the scheduling environment and dynamically adjusts its policy as workload changes. We implement DRAS into a HPC scheduling platform called CQGym. CQGym provides a common platform allowing users to flexibly evaluate DRAS and other scheduling methods such as heuristic and optimization methods. Furthermore, the experiments using CQGym with different production workloads demonstrate that DRAS outperforms the existing heuristic and optimization approaches by up to 50%.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Update on Covariance Data Testing Strategy at LANL [Slides]

LANL is working towards an ENDF/B-VIII.0-based Covariance Library, with several key goals and work processes outlined. This includes processing through NJOY’s ERRORR module, identifying and correcting mathematical and physical deficiencies, communicating across pipeline from evaluator to end user, understanding use cases and interpreting results, and releasing to customers. Their testing approach includes interaction, processing, checks (mathematical properties, constraints, and physical bounds), and error propagation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

A Prototype Software to Demonstrate a Data Catalog for Hanford Environmental Datasets

Ensuring that data on long-term environmental remediation at the Hanford Site is high-quality, traceable, and easily accessible is an ongoing challenge, complicated by decades of data collection, multiple contractors maintaining data sources, and the wide range of data types. A centralized data catalog, known as the Hanford Environmental Information and Data Index (HEIDI), has been under development as part of the Hanford Environmental Data Management (HEDM) program to address these challenges. HEIDI fulfills a critical need to bring together a wide range of data types and sizes from multiple authoritative data sources, while documenting the data pedigree and quality information (i.e., traceable to the data source/originator). This document describes additional development and maturation of the HEIDI prototype. Key accomplishments included deploying the catalog software, Esri Geoportal Server, on a server accessible to Hanford Local Area Network users, conducting cybersecurity evaluations, investigating integrated authentication solutions, and conducting functional testing of the catalog prototype. The server-based deployment enabled targeted feedback, leading to enhancements including improved accessibility features and an expanded metadata schema. Specifications for the server-based deployment of the prototype catalog and the HEIDI metadata schema are provided in this document to support subsequent HEIDI deployment by the U.S. Department of Energy Richland Operations Office.

54 ENVIRONMENTAL SCIENCES↗