Search NASA⌕ Search

SEARCH · Search NASA

Results for “User evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Geographic Information System Based Emergency Response Training Assessments for DOE Radioactive Materials Transport - 20027

Safety and security are priorities of U.S. Department of Energy (DOE) radioactive materials shipping campaigns. In the more than 70-year history of domestic transport of spent nuclear fuel (SNF), there has never been a transportation-related radiological injury. To support transportation planning, among the tools that DOE uses is the Stakeholder Tool for Assessing Radioactive Transportation (START). START contains geospatial data and transportation route analyses capabilities designed to support a range of DOE transportation planning initiatives. One of those functions is the capability to support emergency response planning and training for State and Tribal jurisdictions located on routes used for DOE shipments of radioactive materials. As part of the Department's commitment to public safety, DOE provides federally-funded radiological response training to emergency responders along DOE radioactive materials transportation corridors through its Transportation Emergency Preparedness Program (TEPP). START contains spatial data representing the locations and emergency-response capabilities of fire departments, police, hospitals, State emergency response centers, and where TEPP-trained personnel are based. The START tool supports State and Tribal users' ability to evaluate emergency-response coverage on active and potential DOE radioactive materials transport routes through their jurisdictions, provide expected response times to reach the scene of an incident, identify equipment available to support a response, and identify the number of response personnel and their respective training levels. In addition, START can be used to identify gaps in coverage along a transportation corridor where additional radiological emergency response training may be needed. This paper describes the data, features, and functionality DOE uses to provide a resource for emergency response training needs assessments for States and Tribes along active and potential routes for transporting radioactive materials, and illustrates its use. It also discusses future plans to integrate TEPP and Federal Emergency Management Agency (FEMA) radiological training data to provide a more comprehensive source of geospatial information on personnel who have received equivalent radiological response training. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Integrating Immersive Visualization in Molten-Salt Reactor Waste Management for Experimental Design and Planning

The Molten Salt Reactor (MSR) represents a significant innovation in nuclear technology, offering several operational and safety benefits over traditional solid-fuel reactors. However, MSRs face uncertainties in waste management due to their flexible designs and variable waste compositions. To address these challenges, we propose a visualization platform that illustrates solutions and performance predictions for various waste management strategies, enhancing user experience and improving strategy and communication. Immersive visualizations are widely used in the nuclear industry for training, simulation, and safety enhancement. Our project aims to develop a visualization platform incorporating virtual reality (VR) technologies to illustrate MSR characteristics immediately following reactor shutdown. This immersive simulation will allow users to interact, explore, and understand different waste management strategies. The platform will display MSR reactor characterizations, including nuclide decay, salt solidification, and corrosion, which are crucial for assessing and selecting backend management strategies. Using the Meta Quest 3 VR headset with Unity software, our platform will provide real-scale visualizations, enabling users to experience and evaluate designs and plans as if they were physically present. This user-friendly interface will make complex data accessible and understandable for non-domain experts, aiding in decision-making for MSR waste management. Our proposed visualization workflow can be applied to other nuclear reactors, assisting in the design and planning of waste management strategies.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Heuristic Evaluation Methods Applied to a Predictive Maintenance Chatbot

The need for an accessible iterative approach for evaluating prospective artificial intelligence (AI)/ML based technologies in the nuclear industry is needed, given the nature of algorithms and rapid advancements. This paper explores existing heuristic design principles for user-centered design and evaluates them based on their relevancy and usefulness for evaluating AI/ ML based technologies. Researchers at the Idaho National Laboratory (INL) have developed a machine learning software application called VIsualization for PrEdictive maintenance Recommendation (VIPER), which is used to help users understand and engage with the tool to learn more about work orders, data used, predictive maintenance, and machine learning (ML) algorithms. Early user research studies used to access VIPER’s technology readiness level have occurred; however, there is room for further improvement of the software through heuristic evaluations along with other methods and user testing. This work describes the applicability of heuristic evaluation methods and cognitive walkthroughs to help ensure human readiness for prospective AI/ ML based applications, using VIPER as a candidate use case. This work supports industry in ensuring that prospective AI/ML based technologies are usable and useful for plant personnel at nuclear power plants, ultimately leading to their safe, reliable, and efficient use.

99 - GENERAL AND MISCELLANEOUS↗

Heuristic Evaluation Methods Applied to a Predictive Maintenance Chatbot

The need for an accessible iterative approach for evaluating prospective artificial intelligence (AI)/ML based technologies in the nuclear industry is needed, given the nature of algorithms and rapid advancements. This paper explores existing heuristic design principles for user-centered design and evaluates them based on their relevancy and usefulness for evaluating AI/ ML based technologies. Researchers at the Idaho National Laboratory (INL) have developed a machine learning software application called VIsualization for PrEdictive maintenance Recommendation (VIPER), which is used to help users understand and engage with the tool to learn more about work orders, data used, predictive maintenance, and machine learning (ML) algorithms. Early user research studies used to access VIPER?s technology readiness level have occurred; however, there is room for further improvement of the software through heuristic evaluations along with other methods and user testing. This work describes the applicability of heuristic evaluation methods and cognitive walkthroughs to help ensure human readiness for prospective AI/ ML based applications, using VIPER as a candidate use case. This work supports industry in ensuring that prospective AI/ML based technologies are usable and useful for plant personnel at nuclear power plants, ultimately leading to their safe, reliable, and efficient use. PowerPoint for conference that was reviewed in PRS and LRS PRS/CON-25-05379 and INL/CON-25-82946

99 - GENERAL AND MISCELLANEOUS↗

A Test Bed for Evaluating Frequency Estimation Algorithms in Synthetic Inertia Control: User Manual

As penetration of converter interfaced generators (CIGs) increases, the need for CIG frequency control participation increases. Traditionally, research in this area has been performed using positive sequence simulation software, which provides voltage magnitude and phase measurements, but not point-on-wave (POW) measurements. This means that the effect of frequency estimation algorithms cannot be accurately modeled, especially when the voltage waveform is distorted by faults or load connection events. This report serves as a user manual for an electromagnetic transient simulation testbed, which allows for accurate modeling of frequency estimation and control techniques.

42 ENGINEERING↗

Analysing Scales of Precipitation

The Analysing Scales of Precipitation (ASoP) package is being interfaced with the DOE Coordinated Model Evaluation Capabilities (CMEC) project. Users will be able to use the cmec-driver software to easily run ASoP and generate precipitation metrics as part of climate model evaluation workflows. These metrics provide information about the spatial and temporal patterns of precipitation at different timescales.

Ordonez, AnaC.↗

FLASSH 1.0: Thermal scattering law evaluation and cross section generation for reactor physics applications

The Full Law Analysis Scattering System Hub (FLASSH) is a modern, advanced code which evaluates the thermal scattering law (TSL) along with accompanying cross sections. FLASSH features generalized methods which accommodate any material structure. Historical approximations including the incoherent and cubic approximations have been removed. Instead, the latest release of FLASSH features advanced physics options including distinct corrections (1-phonon contributions) and non-cubic formulations. The non-cubic elastic and inelastic contributions are necessary to accurately evaluate 1-phonon contributions. Both non-cubic and 1-phonon calculations require high-density sampling of the various scattering directions. Optimization and parallelization of these routines were therefore necessary to produce results in a reasonable timeframe. With these notable improvements to the generalized TSL, FLASSH 1.0 meets benchmark requirements, demonstrating noticeable agreement with experiment for both TSLs and the resulting integrated cross sections. Additional features including a graphical user interface (GUI), plotting diagnostics, and formatted output options including ACE files allow users to complete a TSL evaluation with minimal input and maximum flexibility. The user GUI creates input files for FLASSH, reducing user error and also providing built-in error checks. Autofill options and suggested input values help make TSL evaluation accessible to novice users. The FLASSH code is compiled to run on both Windows and Linux platforms with automatic parallelization. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Beowulf v2.5.3 User Guide: Revision 5

This document is a user guide for the Beowulf (rebranding of Watchmen) tool. It describes how operators can access and utilize the application's functionality. Beowulf is a research software application developed by Pacific Northwest National Laboratory (PNNL) that incorporates the scientific and operational expertise for reviewing data from treaty monitoring radionuclide stations. These stations are part of a worldwide network to monitor for nuclear explosions, and the data they produce are critical to make the determination of whether a sample is from a nuclear explosion or some other source (i.e., nuclear reactor or medical isotope production facility). Stations deliver their measurements and system status to the International Monitoring System (IMS), which forwards it via email to all subscribers. Beowulf is capable of processing data from several radioxenon station types and development is in progress on a solution for particulate stations. Screening of data in Beowulf may be done by a number of different users such as radionuclide analysts, evaluators, and data quality experts. This guide is provided to assist those users in navigating the application. The term Beowulf is used generically throughout this document to refer to any of the various components in the software application. The user interface that is viewed with a web browser is the primary focus of this user guide. Other components include a database to store measurements and state of health (SOH) data; and the data loader that monitors incoming emails, parses the data, populates the database, does the initial analysis, and routes data for review.

97 MATHEMATICS AND COMPUTING↗

Carbon Transport and Storage Planning and Viability Support Tools

The EDX disCO2ver Carbon Transport and Storage Planning and Viability Support Tools are made up of the Carbon Storage Planning Inquiry Tool (CS PlanIT, Justman et al. 2024) and the Carbon Storage Technical Viability Approach Support Tool (CS TVA). Together, these tools support data access to support understanding data availability to support planning efforts for carbon transport and storage. The Carbon Storage Planning Inquiry Tool (CS PlanIT) is an online web mapping application designed to help users explore, query, and evaluate multiple data layers to support and accelerate carbon storage resource and feasibility assessments and planning efforts. CS PlanIT currently contains a range of datasets associated with geologic, technical, and infrastructure factors. The data sets can be filtered geographically for an area of interest to update statistics and charts within the dashboard. The dashboard is divided into different sections called widgets, relating to different steps in the carbon storage planning process. The resources in this submission include a link to PlanIT, as well as a data catalog and link to user documentation. The original citation for the CS PlanIT tool, which has now been integrated into the toolset here, was: - Devin Justman, Scott Pantaleone, Maneesh Sharma, Lucy Romeo, Paige Morkner, CS PlanIT (Carbon Storage Planning Inquiry Tool) , 6/28/2024, https://edx.netl.doe.gov/dataset/cs-planit-carbon-storage-planning-inquiry-tool, DOI: 10.18141/2377953 The Carbon Storage Technical Viability Approach Support (CS TVA) Tool displays spatial data availability for the many components of Geologic Carbon Storage (GCS) technical viability assessment (Creason al 2025). Identifying sites suitable for GCS requires evaluating the intersection of myriad factors, including reservoir conditions, subsurface and surface hazards, infrastructure requirements, and energy community metrics. The technical viability of a site can only be confirmed for instances where all these factors have data available, and where those data support viability. Additional Resources related to the Technical Viability Assessment Tool: - Julia Mulhern, Casey White, Araceli Lara, Neyda Cordero Rodriguez, Zachary Jackson, Jacob Shay, Gabriel Creason, MacKenzie Mark-Moser, Paige Morkner, Kelly Rose, Carbon Storage Technical Viability Approach (CS TVA) Database, 3/26/2025, https://edx.netl.doe.gov/dataset/edx4ccs-carbon-storage-technical-viability-approach-database , DOI:10.18141/1984655 - Julia Mulhern, MacKenzie Mark-Moser, Gabriel Creason, Casey White, Araceli Lara, Neyda Cordero Rodriguez, Zach Jackson, Paige Morkner, Kelly Rose, Carbon Storage Technical Viability Approach (CS TVA) Matrix, 3/27/2025, https://edx.netl.doe.gov/dataset/carbon-storage-technical-viability-approach-cs-tva-matrix , DOI: 10.18141/2539979 - Gabriel Creason, Zach Jackson, Neyda Cordero Rodriguez, Julia Mulhern, Casey White, Araceli Lara, MacKenzie Mark-Moser, Paige Morkner, Kelly Rose, Carbon Storage Technical Viability Approach (CS TVA) Data Availability Results Database, 3/27/2025, https://edx.netl.doe.gov/dataset/carbon-storage-technical-viability-approach-cs-tva-data-availability-results-database, DOI:10.18141/2538557

Carbon storage↗

A method and tool to determine the colorimetric and photobiological properties of light transmitted through glass and other optical materials

Here we describe a framework and provides a computational tool to characterize the color quality and biological potential of light that is transmitted through glass and other optical materials. The IES TM-30 framework and Excel computation tool were adapted to evaluate color quality, with measures from CIE S 026, UL 24480, and the WELL Building Standard v2 added to evaluate biological potential. The user selects a pre-transmittance spectral power distribution (SPD), such as for a CIE D-Series Illuminant, Planckian radiation, electric lamp, or measurement of daylight at a building site. The tool allows a user to populate a database with spectral data for glazing or other optical materials, comprising spectral transmission and the spectral reflectance of both sides. The user creates a unit with one, two, or three panes of glazing or other optical materials, and the tool calculates the composite spectral transmittance accounting for reflections between materials. The tool computes the transmitted SPD, then determines colorimetric and photobiological outputs using the transmitted SPD as the test source. Glass, window, and skylight manufacturers can employ the tool to optimize glazing spectral transmission to achieve intentional colorimetric and photobiological performance with transmitted light. Electric lighting manufacturers, designers, and researchers can use the tool to evaluate the impact of glazing units and other optical materials on the color quality and biological potential of transmitted light.

36 MATERIALS SCIENCE↗

NREL 25-cm2 High-Pressure Low-Temperature Electrolysis Cell Hardware (Open Source)

This data resource describes an open-source cell hardware that enables low temperature electrolysis (LTE) testing at elevated pressures. Existing commercial options have several downsides when it comes to R&D testing. They are often not designed for repeated reassembly, may not be able to accommodate porous transport layers with different thicknesses, and do not give state-of-the-art performance. Therefore, this hardware was developed specifically with LTE R&D in mind and its design is being made available to the global LTE community. This work was planned and funded by the U.S. Department of Energy's H2NEW consortium (https://h2new.energy.gov/). The hardware design package (.zip file) details the drawings, auxiliary materials, and procedures required to fabricate, assemble, and operate the National Renewable Energy Laboratory's (NREL's) high-pressure low-temperature electrolysis cells. While the hardware itself—end plates, current collectors, flow fields, bolts and washers, tube fittings—is always the same, the assembly and operating procedures may change depending on the active materials being tested, especially for the membrane. Material-specific assembly and operating procedures will be posted to the H2NEW website as they are developed and validated. Disclaimer: The documents and drawings included in this download package describe a design for a low temperature electrolysis hardware that is intended to comply with leak testing according to ASME B31.1. Safe operation at ambient and elevated pressures is the sole responsibility of the end user, which should be evaluated on a case-by-case basis for each individual cell. Factors affecting the sealing capability may depend on, for example, machining quality, cell assembly components, operating conditions, and operating history. Operation at pressure should only be performed on qualified test stands by qualified operators. NREL/ALLIANCE FOR SUSTAINABLE ENERGY, LLC/DOE DISCLAIM ALL WARRANTIES, EXPRESS OR IMPLIED, INCLUDING THE WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE, AND MAKES NO WARRANTY AS TO THE ACCURACY, COMPLETENESS, OR USEFULNESS OF ANY INFORMATION PROVIDED HEREIN. USE OF THIS PACKAGE IS AT THE USER’S OWN RISK.

08 HYDROGEN↗

Evidential Deep Learning: Enhancing Predictive Uncertainty Estimation for Earth System Science Applications

Abstract Robust quantification of predictive uncertainty is a critical addition needed for machine learning applied to weather and climate problems to improve the understanding of what is driving prediction sensitivity. Ensembles of machine learning models provide predictive uncertainty estimates in a conceptually simple way but require multiple models for training and prediction, increasing computational cost and latency. Parametric deep learning can estimate uncertainty with one model by predicting the parameters of a probability distribution but does not account for epistemic uncertainty. Evidential deep learning, a technique that extends parametric deep learning to higher-order distributions, can account for both aleatoric and epistemic uncertainties with one model. This study compares the uncertainty derived from evidential neural networks to that obtained from ensembles. Through applications of the classification of winter precipitation type and regression of surface-layer fluxes, we show evidential deep learning models attaining predictive accuracy rivaling standard methods while robustly quantifying both sources of uncertainty. We evaluate the uncertainty in terms of how well the predictions are calibrated and how well the uncertainty correlates with prediction error. Analyses of uncertainty in the context of the inputs reveal sensitivities to underlying meteorological processes, facilitating interpretation of the models. The conceptual simplicity, interpretability, and computational efficiency of evidential neural networks make them highly extensible, offering a promising approach for reliable and practical uncertainty quantification in Earth system science modeling. To encourage broader adoption of evidential deep learning, we have developed a new Python package, Machine Integration and Learning for Earth Systems (MILES) group Generalized Uncertainty for Earth System Science (GUESS) (MILES-GUESS) ( https://github.com/ai2es/miles-guess ), that enables users to train and evaluate both evidential and ensemble deep learning. Significance Statement This study demonstrates a new technique, evidential deep learning, for robust and computationally efficient uncertainty quantification in modeling the Earth system. The method integrates probabilistic principles into deep neural networks, enabling the estimation of both aleatoric uncertainty from noisy data and epistemic uncertainty from model limitations using a single model. Our analyses reveal how decomposing these uncertainties provides valuable insights into reliability, accuracy, and model shortcomings. We show that the approach can rival standard methods in classification and regression tasks within atmospheric science while offering practical advantages such as computational efficiency. With further advances, evidential networks have the potential to enhance risk assessment and decision-making across meteorology by improving uncertainty quantification, a longstanding challenge. This work establishes a strong foundation and motivation for the broader adoption of evidential learning, where properly quantifying uncertainties is critical yet lacking.

Schreck, John S.↗

Performance and Reliability Assessment of the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) Data Advisor (ADA)

The Atmospheric Radiation Measurement (ARM) User Facility provides one of the world's largest openly accessible repositories of atmospheric observations through the ARM Data Discovery platform. Although the repository contains more than three decades of measurements collected from permanent observatories, mobile facilities, aircraft campaigns, and field experiments, identifying appropriate datasets can be challenging, particularly for new users unfamiliar with ARM instrumentation and datastream organization. To improve data accessibility, the ARM Data Center developed the ARM Data Advisor (ADA), an artificial intelligence-powered assistant designed to facilitate scientific data discovery, dataset interpretation, and user guidance. This report evaluates ADA's performance as a domain-specific scientific assistant using realistic atmospheric science workflows. The evaluation examines five key capabilities: data retrieval and curation efficiency, hallucination resistance, scientific reasoning, response to ambiguous queries, and content retention and session continuity. Representative prompts were developed to simulate typical interactions between researchers and the ARM Data Discovery platform, and ADA's responses were assessed for retrieval completeness, scientific accuracy, consistency, and practical usefulness. In these representative tests, ADA reduced the complexity of discovering and accessing ARM datasets by recommending appropriate datastreams, explaining instrumentation, interpreting metadata, and assisting with data processing workflows. ADA also exhibits strong domain knowledge of atmospheric science terminology and generally resists hallucination by acknowledging unavailable datasets and requesting clarification when appropriate. Overall, the results indicate that ADA represents a promising advancement in scientific data discovery within the ARM User Facility and has considerable potential to improve researcher productivity, particularly for new users and interdisciplinary scientists seeking efficient access to ARM observations.

Salvador, Christian [ORNL] (ORCID:0000000283287777↗

Proceedings for the Workshop on Applied Nuclear Data Activities 2024

The Workshop for Applied Nuclear Data Activities (WANDA) is designed to increase communication among nuclear data (ND) users in multidisciplinary federal programs, ND producers, ND funders, and other ND experts. It also presents an opportunity to cross-pollinate ideas as well as introduce ND gaps identified by federal programs to ND experts and ND capabilities to the various federal ND users. WANDA 2024 included five technical sessions, three of which focused on Fusion Energy Sciences (FES)—FES Fusion Neutronics, FES Tritium Production, and FES Material Damage—and two stand-alone sessions—Isotopes and Targetry for Nuclear Data and Uncertainty Quantification. The FES sessions successfully brought new voices to the WANDA discussions, expanding the application space in which nuclear data are critical. FES programs need accurate nuclear data with realistic uncertainty quantification to properly estimate, for example, shielding, activation, tritium production, helium production, structural material integrity, and superconducting magnet operation. This includes a variety of projectile (neutrons, photons, charged particles) and target atoms. One of the action items common to all the FES sessions was a need to perform sensitivity studies to identify the prioritization of nuclear data needs. The Isotopes and Targetry session highlighted the many capabilities available to produce high-quality targets for nuclear data measurements, including 3D printing with spherical powders, combustion synthesis coupled with spin coating & electrospraying, inkjet printing, and isotopic doping. These new methods open doors for more accurate measurement, but it was also stressed that sample characterization following any method of fabrication is of the highest importance to accurately interpret nuclear data measurement results that used that sample. The Uncertainty Quantification (UQ) session was broken into two categories: nuclear data uncertainty quantification and the use of that uncertainty quantification. Thematic to the UQ session was the loss of information when going from nuclear data measurement, to evaluation, to evaluated file, and finally to neutron transport calculations. Current evaluated ND libraries typically only contain covariances, which assume that the probability distributions are Gaussian. Beyond being a simplified assumption for many evaluations, this can lead to negative values on many observables when attempting to sample the covariance. The covariance format, however, is very efficient in that a simple set of linear equations can transform uncertainty from parameters or cross sections to the application of interest. Focused collaboration is needed between nuclear data evaluators and nuclear data users to ensure that needs are being met.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Nucleus++ : a new tool bridging AME and NUBASE for advancing nuclear data analysis

The newly developed software, Nucleus++ , is an advanced tool for displaying basic nuclear physics properties from NUBASE and integrating comprehensive mass information for each nuclide from Atomic Mass Evaluation. Additionally, it allows users to compare experimental nuclear masses with predictions from different mass models. Building on the success and learning experiences of its predecessor, Nucleus , this enhanced tool introduces improved functionality and compatibility. With its user-friendly interface, Nucleus++ was designed as a valuable tool for scholars and practitioners in the field of nuclear science. Finally, this article offers an in-depth description of Nucleus++ , highlighting its main features and anticipated impacts on nuclear science research.

AME↗

IRIS: A Portable Runtime System Exploiting Multiple Heterogeneous Programming Systems

Across embedded, mobile, enterprise, and HPC systems, computer architectures are becoming more heterogeneous and complex. This complexity is causing a crisis in programming systems and performance portability. Several programming systems are working to address these challenges, but the increasing architectural diversity is forcing software stacks and applications to specialize for each architecture. As we show, all of these approaches critically depend on their runtime system for discovery, execution, scheduling, and data orchestration. To address this challenge, we believe that a more agile and proactive runtime system is essential to increase performance portability and improve user productivity. In this regard, we have designed and implemented IRIS: a portable runtime system exploiting multiple heterogeneous programming systems. IRIS can discover available resources, manage multiple diverse programming systems (e.g., CUDA, Hexagon, HIP, Level Zero, OpenCL, OpenMP) simultaneously in the same execution, respect data dependencies, orchestrate data movement proactively, and provide for user-configurable scheduling. Our evaluation on three architectures, ranging from Qualcomm Snapdragon to a Summit supercomputer node, shows that IRIS improves portability across a wide range of diverse heterogeneous architectures with negligible overhead.

Kim, Jungwon↗

Model Assessment Wizard (MAW)

SAND2026-18710O The Model Assessment Wizard (MAW) is a tool for evaluating ontologies and provides users with a comprehensive workbench for analysis. MAW features sub-modules for visualization, alignment, Shapes Constraint Language (SHACL) and Web Ontology Language (OWL) constraints, and simplification. Users can upload data, identify missing information, visualize ontologies, and update constraints. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy's National Nuclear Security Administration under contract DE-NA0003525.

Murdock, Jaimie [Sandia National Lab. (SNL-CA), Li↗