Usability Evaluation of Cloud for HPC Applications
Explore the source record for details and available documents.
Sochat, V. [Lawrence Livermore National Laboratory↗
SEARCH · Search NASA
Results for “usability evaluation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Assessment of Electric Grid Transmission System Simulator for Human Factors Research
Over the past decades, various technologies have been developed for electric grid operations to support clean energy, meet rising electricity demands, and address infrastructure concerns. However, the human factors aspect is often overlooked during rapid integration. Questions persist about how these technologies impact human performance. Simulators play a critical role in supporting investigation of human factors design concepts and conducting comprehensive usability testing to evaluate human performance and assess human reliability. This paper aims to address human factors research simulator requirements and conduct a comparative study of six different simulators. A detailed evaluation reveals that the evaluated simulators lack the ability to customize user interfaces. Additionally, their user interface designs do not fulfill the basic human factors design principles, potentially leading to increased response variability and reduced statistical power when conducting controlled experimental research. In the future, it is essential to develop scripting tools to integrate customizable user interfaces and simulation models, ensuring meeting research requirements.
Li, Ruixuan↗
Advancing material modeling in hydrocodes using a concurrent finite-element and molecular dynamics multiscale framework
We present a multiscale simulation framework that couples the finite-element method with molecular dynamics. Bypassing traditional equations of state (EOS) by using in-line atomistic simulations, the method offers the advantage of incorporating detailed microscale physics not easily represented with coarse-grained models. Coupling consistency with the continuum code is ensured through the use of lifting and restriction operators, in line with heterogeneous multiscale methods. The concurrent continuum-atomistic framework is validated through comparison with experimental results and conventional EOS models, and demonstrated in a shock-driven hydrodynamic flow simulation under extreme conditions. We further evaluate the framework's usability by comparing it to state-of-the-art EOS models of deuterium. A computational performance study reveals that the atomistic EOS evaluation is a feasible alternative to conventional approaches, and demonstrates a weak scaling of 99% efficiency. These results highlight the framework's potential for large-scale multiscale modeling across a broad range of materials and conditions.
Computer science↗
Distributed Neural Representation for Reactive In Situ Visualization
Implicit neural representations (INRs) have emerged as a powerful tool for compressing large-scale volume data. This opens up new possibilities for in situ visualization. However, the efficient application of INRs to distributed data remains an underexplored area. Here, in this work, we develop a distributed volumetric neural representation and optimize it for in situ visualization. Our technique eliminates data exchanges between processes, achieving state-of-the-art compression speed, quality and ratios. Our technique also enables the implementation of an efficient strategy for caching large-scale simulation data in high temporal frequencies, further facilitating the use of reactive in situ visualization in a wider range of scientific problems. We integrate this system with the Ascent infrastructure and evaluate its performance and usability using real-world simulations.
Wu, Qi↗
Level-2 Milestone 9009: Flux and Rabbit Capabilities on El Capitan
This document is the milestone delivery report for the ASC 2025 L2 milestone (See Table 1) for advanced I/O capabilities for El Capitan via Flux Workload Manager support and the new I/O hardware designed for El Capitan, the Rabbit Storage System. In this document we describe the design of the Rabbit Storage System and how it is managed by Flux. We evaluate the performance and usability of Rabbit using ARES, IOR, and an AI inference workload. Overall, we find that Rabbit shows good scalability, especially in node-local storage configurations, and is more scalable than the global Lustre parallel file system.
97 MATHEMATICS AND COMPUTING↗
Improving the User Interface of the DeepLynx Data Warehouse
DeepLynx is an open-source ontology-based data warehouse created by INL to support the creation and life cycle of digital engineering projects, with a particular emphasis on digital twins [1]. Digital twins are systems that represent physical assets and process in a real-time digital environment [1]. Most well-known commercial data warehouses use Graphical User Interfaces (GUIs) for users to interact with their systems [3]. Limited publications have addressed the design of these interfaces and understanding of their target users. The current users and development team acknowledge the need to improve the current UI, not just for aesthetics but to improve functionality and workflow of DeepLynx. Traditional data warehouse users are developers, data scientists and business analysts [2]. DeepLynx users have a vast range of experience using data warehouses, and diverse roles, including engineers, scientists and management positions. Because there is a broader audience of target users for DeepLynx than a typical data warehouse, it is essential that DeepLynx has a useable and intuitive user interface. To achieve this the team performed human-computer interaction methods, including a Heuristic Evaluation of current UI using Neilsen’s Usability Heuristic, create personas based on current users by designing a user survey, data analysis and develop of personas. Followed by a redesign of the UI following using Neilsen’s Usability Heuristic and Norman’s Principles of Interactive Design in industry standard software Figma. Lastly a Heuristic Evaluation of new UI design, using Neilsen’s Usability Heuristic and User testing of redesign UI and have a group of users complete a Thinking Aloud Test of the new UI. Preliminary results of the Heuristic Evaluation of current UI arise issue with Consistency and Standards, Visibility of System Status, Match System and Real World and Recognition Rather than Recall. These issues were addressed in the proposed redesign by applying Neilsen’s Usability Heuristic and Norman’s Principles of Interactive Design. Next steps include formalized list of lessons learned and design implications for future publications.
97 MATHEMATICS AND COMPUTING↗
Employing MACS/ViBRANT as a Surrogate MARVEL Reactor for Startup Reactivity Tuning and Supervisory Control Processes
Advanced nuclear reactors are a key part of the future of nuclear energy both in the United States and globally. They offer unique benefits for various energy-demanding applications, including use in remote locations, compact size, modular manufacturing, remote monitoring, low and/or variable power rating operation, and reliance on novel technologies to enhance operational safety. To achieve economic feasibility, advanced reactors must significantly reduce their workforces in comparison with the current fleet. Achieving this reduction will occur through reducing staff workloads using technology to achieve autonomous or semi-autonomous operations, demonstrated by comprehensive testing and validation activities. These operations will require both software and hardware platforms during the design and testing phases. While simulations are useful during the design phase, their performance can significantly deviate during actual deployment on hardware. This report presents the outcomes of a collaborative technical initiative between the U.S. Department of Energy (DOE) Microreactor Program (MRP) and Advanced Sensors and Instrumentation (ASI) Program. The collaboration utilized the Microreactor Automated Control System (MACS) hardware platform to bridge the gap between theoretical reactor design and actual startup and control operations. Two key use cases were investigated: facilitating the startup testing period and demonstrating supervisory control. The first use case details the key Microreactor Applications Research Validation and Evaluation (MARVEL) reactor startup physics testing activities conducted using the MACS platform. These activities included drum worth measurements, shutdown margin assessment, temperature feedback analysis, and scram time evaluation, as well as unique testing that would apply to the MARVEL reactor to demonstrate the testing methodologies in a low-risk environment. The MACS platform, serving as a surrogate representation of the MARVEL reactor, proved instrumental in performing these tests. The exercise revealed aspects that led to optimized processes, refined hardware design, and enhanced base software capabilities. By maturing methods and technologies in this manner, the initiative promises to reduce wasted time in the actual on-site reactor deployment effort, thereby saving significant time and resources. The second use case focuses on the development and implementation of supervisory control methods aimed at managing core tilt, which can result from asymmetrical operations or manufacturing imperfections in fuel rods or reactivity control devices. A key objective was to assess and compare the use of artificial intelligence (AI) for supervisory control. The effort aimed to define the role of supervisory control to enhance performance without risking control instability. This effort explored three distinct approaches: rules-based (RB) methods, optimization techniques, and reinforcement learning (RL) algorithms. Each approach was evaluated for its ease of implementation, its usability, and its effectiveness in responding to asymmetries in neutron flux. Comparative analysis of these approaches provided valuable insights into their applicability and effectiveness, offering a robust framework for advanced reactor operations. Together, these two use cases highlight the potential of hardware test beds to help streamline the design, operation, and control of advanced nuclear reactors. This collaborative effort underscores the importance of continued innovation and experimentation in achieving the next generation of safe, reliable, and economically viable nuclear energy solutions.
22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
A Brief Survey on High Performance Computing Systems Power Management
This paper provides a survey of software-based power management techniques in High Performance Computing (HPC) systems. Seven existing power management and monitoring tools and frameworks are discussed. These are: Variorum, dynamic energy-performance optimizer (DEPO), Powersched, Bull Dynamic Power Optimizer (BDPO), Energy Aware Runtime (EAR), Global Extensible Open Power Manager (GEOPM), and PoLiMEr. Each of these tools is evaluated based on hardware abstraction, optimization methods, usability, and experimental validation. This survey highlights the diversity of approaches in managing energy efficiency, from vendor-neutral APIs to algorithm-driven power capping, and dynamic frequency adjustments. Given that energy requirements for large computational systems is increasing quickly, the importance of integrating these tools into existing HPC environments and the need for further research in this rapidly evolving field is also discussed.
97 - MATHEMATICS AND COMPUTING↗
Dispatch Manager for NEML2 Constitutive Model Calculations Embedded in MOOSE
This report describes the extended capabilities of the NEML2 constitutive modeling library, including a flexible and efficient work dispatching system designed to leverage both CPU and GPU resources. This enhancement addresses one of the primary computational challenges in large-scale simulations: the ability to distribute and execute batches of material model evaluations across heterogeneous computing devices. The new dispatch system introduces a modular set of dispatcher and scheduler classes that coordinate the flow of data and execution between devices. The dispatcher is responsible for efficiently packaging work, managing device-specific memory operations, and synchronizing results. This modularity allows for extensibility, making it straightforward to integrate additional computing backends in the future. From an implementation standpoint, the dispatcher system interfaces seamlessly with NEML2's existing models. They handle device-aware tensor operations, optimize memory transfers, and support asynchronous execution when applicable. This design ensures that batches of material points can be evaluated concurrently, substantially improving throughput compared to previous single-device or serial implementations. These improvements not only enhance the raw performance of NEML2 but also improve its usability in multiscale and high-fidelity simulations, where the simultaneous evaluation of large material point batches is critical. Benchmarks included in the report demonstrate the system’s scalability, highlighting its effectiveness when leveraging modern GPU architectures.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Re-Evaluating Virtual Reality Manipulation Techniques for Precise Alignment of Complex 3D Objects
Prior research has developed a number of manipulation techniques that can achieve precise object placement in virtual reality, but studies of these techniques typically use simple objects. We conducted a study comparing two existing techniques, (AMP-IT and WISDOM), during alignment of objects with complex geometry to evaluate the potential influence of geometric complexity on performance, usability, workload and preference. Our findings indicate that participants had faster completion times and higher trial completion rates with AMP-IT on high-precision alignment tasks, contrary to earlier findings that used simple objects. Yet WISDOM is still preferred and considered more usable, despite increased workload and poorer performance, exposing participants' willingness to trade objective performance for comfort during use.
97 MATHEMATICS AND COMPUTING↗
Trusted Simulation: Considering Model Quality in the Context of User Trust
A high‐quality simulation model should help its users to easily and appropriately calibrate their trust in the model. Traditional evaluation metrics such as validation and robustness are necessary but insufficient for this task. Trust calibration depends on factors like the model's transparency, applicability to intended use, usability, reputation, and consideration of potential bias. This article proposes a framework for designing and evaluating system dynamics models by considering factors that contribute to the proper calibration of user trust. This framework takes inspiration from trusted artificial intelligence, broadening our traditional concept of model quality and explicitly focusing on what users need to consider a model trustworthy and to understand the model's relevance to its intended purpose. The trusted simulation framework can improve our integration of model quality activities throughout the modeling process, leading to more impactful and better‐targeted model design, development, and evaluation.
Naugle, Asmeret Bier [Sandia National Laboratories↗
Homomorphic Encryption for Electrical Metering Aggregation: Protecting the Privacy of Building Tenants
Electrical meters are devices that measure consumer electricity usage. The data collected by these meters is necessary for utility billing and electrical grid management but can also be used to assess the environmental impact of buildings. Prior research has found that unprotected metering data could potentially be used to infer some information about the behaviors of building tenants by detecting changes in electricity usage. For example, a period of low electricity usage could suggest that the tenants are not in the building. As smart metering becomes more common, there is a growing need for data privacy protections for metering data that do not negatively impact the quality and availability of data used for energy management and billing applications. To identify potential solutions, we developed a Python-based data aggregation platform to analyze the potential efficacy of privacy-enhancing technologies for energy metering applications. This platform aggregates groups of metering sites into virtual buildings, which could potentially detach changes in electrical activity from individual tenants, making it more difficult to track the activity of a specific tenant. To further protect data during analysis, this project utilizes homomorphic encryption as part of its initial approach. Homomorphic encryption offers a means of protecting energy consumption data while permitting mathematical operations to be performed without the need to know the data contents. This allows for data to be processed into usable statistics without revealing energy consumption information. A series of homomorphic encryption libraries were evaluated to determine their applicability and limitations in the context of metering data. The use of these techniques may help to reassure consumers and encourage further adoption of smart grid infrastructure.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
Reassessment of PHDS Fulcrum40h High Purity Germanium (HPGe) Detector System Performance
This report presents a comprehensive evaluation of the updated PHDS Fulcrum40h High Purity Germanium (HPGe) detector system, benchmarking its performance, usability, and software capabilities against the current National Nuclear Security Administration (NNSA) Nuclear Emergency Support Team (NEST) HPGe Detector System Requirements Document. Systematic measurements were conducted using a single Fulcrum40h detector to assess key parameters including gamma efficiency and resolution, neutron detection efficiency, gamma pulse-pileup response, and gamma-to-neutron crosstalk. The Fulcrum40h system, acquired in August 2022, has undergone recent updates by PHDS to address deficiencies identified following the initial NEST requirements release. The results provide critical insights into the detector’s operational capabilities and compliance with NNSA NEST standards.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Detecting Process Equipment Failures Using Acoustic Data and Machine Learning
Nuclear power plant (NPP) process equipment such as fans, motors, valves, and pumps generate frequent or continuous noise, and deviations from the normal operational sounds made by this equipment can indicate potential issues. These deviations can be identified via automated acoustic anomaly detection, which involves using acoustic sensors (i.e., microphones) alongside detection algorithms to continuously monitor for changes in acoustic signatures. This task is made challenging by the substantial background noise that exists, such as operators opening and closing doors, manipulating valves, and conversing—in addition to typical plant noises. In collaboration with a nuclear power utility partner, this effort assessed the efficacy of acoustic anomaly detection when using a specific acoustic sensor that compresses data into a fixed set of features that are transferable over a standard Internet of Things communication protocol, thereby improving usability but potentially degrading detection performance. Two methods of performing automated acoustic anomaly detection were evaluated: one-class support vector machine (OC-SVM) and isolation forest (iForest). To enable the use of high-quality acoustic data encompassing both normal and anomalous conditions, the study utilized the publicly available Malfunctioning Industrial Machine Investigation and Inspection dataset, which includes real measured acoustic sensor data for a range of equipment types, model numbers, and signal-to-noise ratios (SNRs), along with a benchmark set of detection results. Using this dataset, the methods were tested and then compared against the benchmark results. The results indicated that although the specific acoustic sensor did not enable as rich a feature set extraction, the proposed methods with the limited feature set performed just as well. This provides solid justification for both the methods and the use of the proposed acoustic sensor.
46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗
Beyond Contrast Transfer: Spectral SNR as a Finite-Dose Metric for STEM Phase Retrieval
The contrast transfer function (CTF) is widely used to evaluate phase retrieval methods in scanning transmission electron microscopy (STEM), including center-of-mass imaging, parallax imaging, direct ptychography, and iterative ptychography. However, the CTF reflects only the maximum usable signal, neglecting the effects of finite electron fluence and the Poisson-limited nature of detection. As a result, it can significantly overestimate practical performance, especially in low-dose regimes. Here, we employ the spectral signal-to-noise ratio (SSNR), as a finite-dose statistical framework to evaluate the recoverable signal as a function of spatial frequency. Using numerical reconstructions of white-noise objects, we show that center-of-mass, parallax, and direct ptychography exhibit dose-independent SSNRs, with close-form analytic expressions. In contrast, iterative ptychography exhibits a surprising dose dependence: at low fluence, its SSNR converges to that of direct ptychography; at high fluence, it saturates at a value consistent with the maximum detective quantum efficiency predicted by recent quantum Fisher information bounds. The results highlight the limitations of CTF-based evaluation and motivate SSNR as a more accurate, finite-dose metric for assessing STEM phase retrieval methods.
STEM phase retrieval↗
Computational Optimization of Room Temperature Usable Capacity for Hydrogen Storage in MFU-4-Type Metal–Organic Frameworks via Pairwise Metal Substitutions
The efficient storage of hydrogen is a critical challenge in the quest for sustainable energy solutions. Current adsorbent-based methods achieve satisfactory storage densities predominantly under cryogenic temperatures and/or high pressures, which imposes problems with cost-efficient and safe implementation of this technology. Materials that can bind hydrogen gas reversibly at ambient temperatures and more moderate pressures could play a pivotal role in enabling hydrogen-powered technologies. In this study, we use reliable computational modeling to investigate two synthetically feasible paths for tuning the enthalpy of H2 binding in MFU-4-type metal–organic frameworks (MOFs), aiming to maximize usable capacity. This study examines MIM4 IICl3(bta)6 (bta– = benzotriazolate) Kuratowski-type clusters as a model for strong binding sites in MFU-4l frameworks. We systematically evaluate the impact of separately tuning the central MII metal ion (which plays a structural role) and the peripheral MI metal ion (which binds the substrate) on the energetics of H2 binding. Our computational study reveals that H2 binding at an MI site mostly follows the trend AgI < CuI < NiI < CoI < AuI while a larger central MII site generally weakens the H2 binding at a MI site. Importantly, we have identified three new combinations of MI and MII to achieve high fractional usable capacities of the total H2 adsorbed under a pressure swing from 5 to 100 bar at room temperature. Additionally, we examine the nature of the binding interaction between the peripheral metal atom and the hydrogen molecule. While charge transfer predominantly induces this interaction, for several atom combinations, a change in the polarization (associated with variations in the ionic radius of the MI binding atom) is another important factor for adjusting the strength of the interaction. We suggest that the proposed compositions of Kuratowski-type clusters are highly desirable synthetic targets for future laboratory study.
Tkachenko, Nikolay V↗
A multi-model assessment of global freshwater temperature and thermoelectric power supply under climate change
Water temperature is a key abiotic factor influencing aquatic ecosystem health and the services provided to both nature and humans. Global water temperature models offer possibilities to improve our understanding of water temperature regimes, which is increasingly important against the backdrop of climate change. Yet, existing studies have predominantly relied on a single model, which can lead to an incomplete representation of uncertainty and potential biases, in addition to limited insight into the range of possible future conditions, which ultimately reduces the robustness of climate impact assessments. Here, we provide a comprehensive assessment of surface freshwater temperature changes from various river and lake models for both past conditions and under future scenarios of climate change. Global models consistently simulate that surface water temperatures are currently 0.5 °C–0.8 °C higher than at the turn of the century (i.e. 1981–2000), and that warming will extend and intensify with future global change throughout the 21st century. While the strength of warming is highly sensitive to the different water temperature models, emissions scenarios and global climate models, our multi-model ensemble shows a global average annual water temperature rise of between +1.3 °C and +4.1 °C by the end of the century. To illustrate a potential societal impact of our results, we evaluate how future changes in discharge and water temperature may affect existing thermoelectric power plants, estimating average annual reductions of 1.5%–6% in global usable capacity by the end of the century. However, with river water temperatures projected to exhibit more pronounced seasonal patterns in the future—especially under the more extreme climate change scenarios and during summer months in the Northern Hemisphere—intra-annual reductions in usable capacity can be much more severe. Given the challenges associated with (large-scale) adaptation to control water temperature regimes, strong climate change mitigation is crucial for minimising water temperature rises and its associated negative impacts on humankind and ecosystems.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
Heuristic Evaluation Methods Applied to a Predictive Maintenance Chatbot
The need for an accessible iterative approach for evaluating prospective artificial intelligence (AI)/ML based technologies in the nuclear industry is needed, given the nature of algorithms and rapid advancements. This paper explores existing heuristic design principles for user-centered design and evaluates them based on their relevancy and usefulness for evaluating AI/ ML based technologies. Researchers at the Idaho National Laboratory (INL) have developed a machine learning software application called VIsualization for PrEdictive maintenance Recommendation (VIPER), which is used to help users understand and engage with the tool to learn more about work orders, data used, predictive maintenance, and machine learning (ML) algorithms. Early user research studies used to access VIPER’s technology readiness level have occurred; however, there is room for further improvement of the software through heuristic evaluations along with other methods and user testing. This work describes the applicability of heuristic evaluation methods and cognitive walkthroughs to help ensure human readiness for prospective AI/ ML based applications, using VIPER as a candidate use case. This work supports industry in ensuring that prospective AI/ML based technologies are usable and useful for plant personnel at nuclear power plants, ultimately leading to their safe, reliable, and efficient use.
99 - GENERAL AND MISCELLANEOUS↗