Search NASA⌕ Search

SEARCH · Search NASA

Results for “user study”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

A User-Centered Design Study in Scientific Visualization Targeting Domain Experts

The development of usable visualization solutions is essential for ensuring both their adoption and effectiveness. User-centered design principles, which involve users throughout the entire development process, have been shown to be effective in numerous information visualization endeavors. We describe how we applied these principles in scientific visualization over a two year collaboration to develop a hybrid in situ/post hoc solution tailored towards combustion researcher needs. Lastly, we examine the importance of user-centered design and lessons learned over the design process in an effort to aid others seeking to develop effective scientific visualization solutions.

97 MATHEMATICS AND COMPUTING↗

Demonstration and Evaluation of Explainable and Trustworthy Predictive Technology for Condition-based Maintenance

The domestic nuclear power plant (NPP) fleet has historically relied on labor-intensive and time-consuming predictive maintenance (PdM) programs, thus driving up operation and maintenance (O&M) costs to achieve high-capacity factors. Artificial intelligence (AI) and machine-learning (ML) can help simplify complex problems such as diagnosing equipment degradation to enable more effective decision-making efforts. The benefits of AI will be felt through more efficient plant O&M, improved work processes, and better integration of people and technology. Together, these benefits hold the promise to make nuclear power more sustainable by reducing O&M costs while improving employee engagement. While AI and ML technologies hold significant promise for the nuclear industry, there are challenges or barriers to their adoption. Explainability and trustworthiness of AI are two salient challenges that need to be addressed for wider deployment of these technologies in NPPs. This research focuses specifically on addressing the explainability and trustworthiness of AI technologies to advance the human, technical, and organization (HTO) readiness levels in adopting a risk-informed PdM strategy at commercial NPPs. In addition, this approach can be adapted to enhance the acceptability of AI in other nuclear applications with a few application-specific modifications. The technical approach ensuring wider adoption of AI technologies was developed by Idaho National Laboratory (INL)—in collaboration with Public Service Enterprise Group (PSEG), Nuclear, LLC—by utilizing the circulating water system (CWS) at two PSEG-owned plant sites for demonstration. Focused user studies were performed in collaboration with subject matter experts (SMEs) from PSEG and other nuclear domains to enhance human and organization readiness by building trust in AI-informed technologies. VIsualization for PrEdictive maintenance Recommendation (VIPER)—a Battelle Energy Alliance, LLC, copyrighted software—was developed and expanded to provide a user-centric visualization by incorporating inputs from the collaborating utility, human factors engineering guidelines, and data analysts. The VIPER software enables users, who may be unfamiliar with ML in general, to be interactively engaged by asking technical questions about PdM, work orders, diagnosis results and their confidence levels, the kind of data being used, and the types of ML algorithms employed. This interactive engagement enhances explainability and builds trust. One of the enabling accomplishments was the integration of large language models (LLMs), both text-based and vision-based, in the VIPER software.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

SAGE Intrusion Detection System: Sensitivity Analysis Guided Explainability for Machine Learning.

This report details the results of a three-fold investigation of sensitivity analysis (SA) for machine learning (ML) explainability (MLE): (1) the mathematical assessment of the fidelity of an explanation with respect to a learned ML model, (2) quantifying the trustworthiness of a prediction, and (3) the impact of MLE on the efficiency of end-users through multiple users studies. We focused on the cybersecurity domain as the data is inherently non-intuitive. As ML is being using in an increasing number of domains, including domains where being wrong can elicit high consequences, MLE has been proposed as a means of generating trust in a learned ML models by end users. However, little analysis has been performed to determine if the explanations accurately represent the target model and they themselves should be trusted beyond subjective inspection. Current state-of-the-art MLE techniques only provide a list of important features based on heuristic measures and/or make certain assumptions about the data and the model which are not representative of the real-world data and models. Further, most are designed without considering the usefulness by an end-user in a broader context. To address these issues, we present a notion of explanation fidelity based on Shapley values from cooperative game theory. We find that all of the investigated MLE explainability methods produce explanations that are incongruent with the ML model that is being explained. This is because they make critical assumptions about feature independence and linear feature interactions for computational reasons. We also find that in deployed, explanations are rarely used due to a variety of reason including that there are several other tools which are trusted more than the explanations and there is little incentive to use the explanations. In the cases when the explanations are used, we found that there is the danger that explanations persuade the end users to wrongly accept false positives and false negatives. However, ML model developers and maintainers find the explanations more useful to help ensure that the ML model does not have obvious biases. In light of these findings, we suggest a number of future directions including developing MLE methods that directly model non-linear model interactions and including design principles that take into account the usefulness of explanations to the end user. We also augment explanations with a set of trustworthiness measures that measure geometric aspects of the data to determine if the model output should be trusted.

97 MATHEMATICS AND COMPUTING↗

The Impact of Streaming Data on Sensemaking with Mixed-Initative Visual Analytics

Visual data analysis helps people gain insights into data via interactive visualizations. People generate and test hypotheses and questions about data in context of the domain. This process can generally be referred to as sensemaking. Much of the work on studying sensemaking (and creating visual analytic techniques in support of it) has been focused on static datasets. However, how do the cognitive processes of sensemaking change when data are changing? Further, what implication for design does this create for mixed-initiative visual analytics systems? This paper presents the results of a user study analyzing the impact of streaming data on sensemaking. To perform this study, we developed a mixed-initiative visual analytic prototype, the Streaming Canvas, that affords the analysis of streaming text data. We compare the sensemaking process of people using this tool for a static and streaming dataset. We present the results of this study and discuss the implications on future visual analytic systems that combine machine learning and interactive visualization to help people make sense of streaming data.

visualization↗

WaterTAP3 (The Water Technoeconomic Assessment Pipe-Parity Platform)

The Water Technoeconomic Assessment Pipe-Parity Platform (WaterTAP3) was developed under the National Alliance for Water Innovation (NAWI) to facilitate consistent technoeconomic assessments of desalination treatment trains. The WaterTAP3 is an analytically robust modeling tool that can be used to evaluate water technology cost, energy, environmental, and resiliency tradeoffs across different water sources, sectors, and scales. The model simulates steady-state water treatment train performance and costs including flow and constituent mass balance across unit processes, based on source water conditions, configurations of treatment technologies, and system-level techno-economic assumptions. Users can build a new treatment train by connecting any number of unit processes, specific for their context and system, or selecting a train from the treatment train library. The model contains various technical and cost parameter options for a range of treatment processes and a library of influent water quality characteristics for a variety of source waters and case studies. Users can customize water quality parameters to evaluate the technology performance in their context. The model can be set up for different assessment needs including simulation, optimization, and uncertainty and sensitivity analyses. The results from WaterTAP3 can help identify trade-offs among the different system performance metrics, with insight on how particular technologies or systems promote pipe-parity. The flexibility and comprehensive scope of the tool makes it a promising solution to industry-wide water technoeconomic evaluations, leading to more informed water investment decisions and technologies. As a user-friendly, open-source platform, WaterTAP3 can be used by industry, academia, policymakers, planners, and those with or without extensive analytical experience.

Miara, Ariel↗

Water Technoeconomic Assessment Pipe-Parity Platform (WaterTAP3)

The Water Technoeconomic Assessment Pipe-Parity Platform (WaterTAP3) was developed under the National Alliance for Water Innovation (NAWI) to facilitate consistent technoeconomic assessments of desalination treatment trains. The WaterTAP3 is an analytically robust modeling tool that can be used to evaluate water technology cost, energy, environmental, and resiliency tradeoffs across different water sources, sectors, and scales. The model simulates steady-state water treatment train performance and costs including flow and constituent mass balance across unit processes, based on source water conditions, configurations of treatment technologies, and system-level techno-economic assumptions. Users can build a new treatment train by connecting any number of unit processes, specific for their context and system, or selecting a train from the treatment train library. The model contains various technical and cost parameter options for a range of treatment processes and a library of influent water quality characteristics for a variety of source waters and case studies. Users can customize water quality parameters to evaluate the technology performance in their context. The model can be set up for different assessment needs including simulation, optimization, and uncertainty and sensitivity analyses. The results from WaterTAP3 can help identify trade-offs among the different system performance metrics, with insight on how particular technologies or systems promote pipe-parity. The flexibility and comprehensive scope of the tool makes it a promising solution to industry-wide water technoeconomic evaluations, leading to more informed water investment decisions and technologies. As a user-friendly, open-source platform, WaterTAP3 can be used by industry, academia, policymakers, planners, and those with or without extensive analytical experience. A publicly available graphical user interface is currently under development.

Miara, Ariel↗

Advancing Concentrating Solar Thermal Modeling Using System Advisor Model (SAM)

Concentrating solar thermal (CST) technologies play a critical role in enabling dispatchable power and high-temperature industrial heat applications. Accurate and flexible modeling tools are essential for evaluating system performance, guiding technology research and development, and informing investment decisions. The National Laboratory of the Rockies's System Advisor Model (SAM) is a widely used techno-economic simulation platform for CST systems, providing detailed performance and financial modeling capabilities for multiple CST system configurations. SAM integrates physics-based performance models with financial analysis to simulate the behavior of complex energy systems under realistic operating conditions. For CST technologies (including tower, parabolic trough, and linear Fresnel), SAM enables hourly simulations using site-specific weather data that ensure feasible operating conditions and convergence of mass and energy between core system components (i.e., solar field, receiver, thermal energy storage, and power cycle). These capabilities allow researchers and developers to evaluate annual energy production, capacity factors, levelized cost of energy (LCOE), and system dispatch strategies. A key advantage of SAM lies in its flexibility for parametric analysis and large-scale computational studies. Users can vary system design parameters such as heliostat field layout, receiver dimensions, thermal energy storage capacity, power block sizing, and installation cost assumptions to investigate their impact on system performance and financial metrics. When combined with automated scripting through LK, SDKTool, or Python interfaces, SAM enables high-throughput simulation workflows that support sensitivity analysis, technology benchmarking, and optimization studies. These approaches are particularly valuable for next-generation CST concepts, where design spaces are large and system interactions are complex. Another important capability of SAM is its support for dispatch optimization and thermal energy storage modeling, which are central to the value proposition of CST technologies. The ability to simulate integrated storage and flexible power generation allows researchers to explore strategies that maximize grid value, improve capacity utilization, and enhance integration with variable resources such as photovoltaic and wind generation. This poster will present an overview of SAM's thermal system modeling capabilities including concentrating solar. Additionally, we will highlight new feature developments including: 1) implementing Google's OR-Tools optimization platform for faster and more robust dispatch optimization, 2) developing a new power load following controller for modeling behind-the-meter applications, 3) enabling direct modeling of CSP-PV hybrid systems with the inclusion of battery storage, and 4) developing a multi-receiver falling particle Gen3 system model.

14 SOLAR ENERGY↗

Automated Work Packages: Radio Frequency Identification, Bluetooth Beacons, and Video Applications in the Nuclear Power Industry

The need to move conventional paper-based work packages into an electronic state motivated the development of a large span of electronic work package forms that ranged from simple Portable Document Format (PDF) files to adaptive and intelligent electronic forms. In parallel to this development, the Department of Energy Light Water Reactor Sustainability Program (LWRS) initiated the automated work package as a pilot project to evaluate implementing state of the art automation techniques into the work package process to improve the economic and safety of the work process. Through a multiple year’s effort, the automated work package project have developed a vision of the future work package that relies on automation in all critical and human factor challenging tasks. The vision identified gaps in the work process, the means to automate them, and evaluated the implementation, feasibility and benefits of these means. This was conducted through continues engagement with the nuclear power industry. The aim of this report is to study the potential of three automation technologies, which have been advancing in various industries, in the current work process of nuclear power plants. The study is to determine the feasibility and benefits of incorporating the technologies and determine potential gaps, if any, that need to be addressed to facilitate deployment of the studied technologies. The three automation technologies identified for this effort are ultra-high frequency (UHF) radio frequency identification (RFID), Bluetooth low energy (BLE) beacons, and video monitoring and recording. As part of this effort, the Idaho National Laboratory (INL) collaborated with Xcel Energy Inc. to evaluate these technologies. During the research and development scope of the effort, INL engaged Xcel Energy Inc. periodically and exchanged valuable insight on the means to implement these technologies in a nuclear power plant. Multiple pilot prototypes were developed and tested in a user study conducted at Xcel Energy Inc. in Minneapolis, Minnesota. The outcome of this effort resulted in significant findings that included the detailed means to custom fit the technologies to fit the nuclear power industry need, and identifying and evaluating several applications of high economic or safety potential. The limitations and obstacles that could impact deployment of the technologies were also identified, and the means of how to address these limitations and obstacles were studied.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Visual feedback and guided balance training in an immersive virtual reality environment for lower extremity rehabilitation

Balance training is essential for physical rehabilitation procedures, as it can improve functional mobility and enhance cognitive coordination. However, conventional balance training methods may have limitations in terms of motivation, real-time objective feedback, and personalization, which a virtual reality (VR) setup may provide a better alternative. In this work, we present an immersive VR training environment for lower extremity balance rehabilitation with real-time guidance and feedback. The VR training environment immerses the user in a 3D ice rink model where a virtual coach (agent) leads them through a series of balance poses, and the user controls a trainee avatar with their own movements. Here we developed two coaching styles: positive-reinforcement and autonomous-supportive, and two viewpoints of the trainee avatar: first-person and third-person. The proposed environment was evaluated in a user study with healthy, non-clinical participants (n = 16, 24.4 ± 5.7 years old, 9 females). Our results show that participants showed stronger performance in the positive-reinforcement style compared to the autonomous-supportive style. Additionally, in the third-person viewpoint, the participants exhibited more stability in the positive-reinforcement style compared to the autonomous-supportive style. For viewpoint, participants exhibited stronger performance in the first-person viewpoint compared to third-person in the autonomous-supportive style, while they were comparable in the positive-reinforcement style. We observed no significant effects on the foot height and number of mistakes. Furthermore, we report the analysis of user performance with balance training poses and subjective measures based on questionnaires to assess the user experience, usability, and task load. The proposed VR balance training could offer an interactive, adaptive, and engaging environment and open new potential research directions for lower extremity rehabilitation.

97 MATHEMATICS AND COMPUTING↗

Bridging cognitive gaps between user and model in interactive dimension reduction

Interactive machine learning (ML) systems are difficult to design because of the "Two Black Boxes" problem that exists at the interface between human and machine. Many algorithms that are used in interactive ML systems are black boxes that are presented to users, while the human cognition represents a second black box that can be difficult for the algorithm to interpret. These two black boxes create cognitive gaps between the user and the interactive ML model when a user interacts with the system. In this paper, we identify several cognitive gaps that exist in a previously-developed interactive visual analytics (VA) system, Andromeda. These cognitive gaps that we are addressing in Andromeda are representative of common problems in other VA systems. Our goal with this work is to open both black boxes and bridge these cognitive gaps by making improvements to the original Andromeda system, including designing new visual features to help people better understand how Andromeda processes and interacts with data and improving the underlying algorithm so that the Andromeda system can better understand the intent of the user during the data exploration process. We evaluate our designs through both qualitative and quantitative analysis (i.e., user study and simulation analysis), and the results confirm that the improved Andromeda system outperforms the original version significantly in a series of high-dimensional data understanding tasks.

97 MATHEMATICS AND COMPUTING↗

A Survey of Colormaps in Visualization

Colormaps are a vital method for users to gain insights into data in a visualization. With a good choice of colormaps, users are able to acquire information in the data more effectively and efficiently. In this survey, we attempt to provide readers with a comprehensive review of colormap generation techniques and provide readers a taxonomy which is helpful for finding appropriate techniques to use for their data and applications. Specifically, we first briefly introduce the basics of color spaces including color appearance models. In the core of our paper, we survey colormap generation techniques, including the latest advances in the field by grouping these techniques into four classes: procedural methods, user-study based methods, rule-based methods, and data-driven methods; we also include a section on methods that are beyond pure data comprehension purposes. We then classify colormapping techniques into a taxonomy for readers to quickly identify the appropriate techniques they might use. Furthermore, a representative set of visualization techniques that explicitly discuss the use of colormaps is reviewed and classified based on the nature of the data in these applications. Lastly, our paper is also intended to be a reference of colormap choices for readers when they are faced with similar data and/or tasks.

97 MATHEMATICS AND COMPUTING↗

Real-Time Omnidirectional Stereo Rendering: Generating 360° Surround-View Panoramic Images for Comfortable Immersive Viewing

Surround-view panoramic images and videos have become a popular form of media for interactive viewing on mobile devices and virtual reality headsets. Viewing such media provides a sense of immersion by allowing users to control their view direction and experience an entire environment. When using a virtual reality headset, the level of immersion can be improved by leveraging stereoscopic capabilities. Stereoscopic images are generated in pairs, one for the left eye and one for the right eye, and result in providing an important depth cue for the human visual system. For computer generated imagery, rendering proper stereo pairs is well known for a fixed view. However, it is much more difficult to create omnidirectional stereo pairs for a surround-view projection that work well when looking in any direction. One major drawback of traditional omnidirectional stereo images is that they suffer from binocular misalignment in the peripheral vision as a user's view direction approaches the zenith / nadir (north / south pole) of the projection sphere. This paper presents a real-time geometry-based approach for omnidirectional stereo rendering that fits into the standard rendering pipeline. Our approach includes tunable parameters that enable pole merging - a reduction in the stereo effect near the poles that can minimize binocular misalignment. Results from a user study indicate that pole merging reduces visual fatigue and discomfort associated with binocular misalignment without inhibiting depth perception.

360° panorama↗

VisIRR: A Visual Analytics System for Information Retrieval and Recommendation for Large-Scale Document Data

In this paper, we present an interactive visual information retrieval and recommendation system, called VisIRR, for large-scale document discovery. VisIRR effectively combines the paradigms of (1) a passive pull through query processes for retrieval and (2) an active push that recommends items of potential interest to users based on their preferences. Equipped with an efficient dynamic query interface against a large-scale corpus, VisIRR organizes the retrieved documents into high-level topics and visualizes them in a 2D space, representing the relationships among the topics along with their keyword summary. In addition, based on interactive personalized preference feedback with regard to documents, VisIRR provides document recommendations from the entire corpus, which are beyond the retrieved sets. Such recommended documents are visualized in the same space as the retrieved documents, so that users can seamlessly analyze both existing and newly recommended ones. This article presents novel computational methods, which make these integrated representations and fast interactions possible for a large-scale document corpus. We illustrate how the system works by providing detailed usage scenarios. Finally, we present preliminary user study results for evaluating the effectiveness of the system.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

TopicOnTiles: Tile-Based Spatio-Temporal Event Analytics via Exclusive Topic Modeling on Social Media

Detecting anomalous events of a particular area in a timely manner is an important task. Geo-tagged social media data are useful resource for this task; however, the abundance of everyday language in them makes this task still challenging. To address such challenges, we present TopicOnTiles, a visual analytics system that can reveal information relevant to anomalous events in a multi-level tile-based map interface by using social media data. To this end, we adopt and improve a recently proposed topic modeling method that can extract spatio-temporally exclusive topics corresponding to a particular region and a time point. Furthermore, we utilize a tile-based map interface to efficiently handle large-scale data in parallel. Our user interface effectively highlights anomalous tiles using our novel glyph visualization that encodes the degree of anomaly computed by our exclusive topic modeling processes. To show the effectiveness of our system, we present several usage scenarios using real-world datasets as well as comprehensive user study results.

Choi, Minsuk↗

TexTonic: Interactive Visualization for Exploration and discovery of Very Large Text Collections

TexTonic is a visual analytic system for interactive exploration of very large unstructured text collections. TexTonic visualizes hierarchical clusters of representative terms, snippets, and documents in a single, multi-scale spatial layout. Exploration is supported by interacting with the visualization and directly manipulating the terms in the visualization using semantic interactions. These semantic interactions steer the underlying analytic model by translating user interactions within the visualization to contextual updates to the supporting data model. The combination of semantic interactions and information visualization at multiple levels of the data hierarchy helps users manage information overload so that they can more effectively explore very large text collections. In this paper we describe TexTonic’s data processing and analytic pipeline, user interface and interaction design principles, and the results of a user study conducted mid-development with experienced data analysts. We also discuss the implications TexTonic could have on visual exploration and discovery tasks

human centered computing, Visual analytics, Inform↗

Caerbannog Point Clouds

The Caerbannog Point Clouds provide point-sampled 3D models occluded in clouds of points. We synthesized the 3D point clouds from polygonal models, point-sampling the models and surrounding them in a point cloud such that the shape of the model is occluded in any 2D projection. We obscure our model-of-interest by repeatedly surrounding it with an amorphous cloud of points, giving the overall point cloud a structure of organic nature, like that of shrubbery. In a user study, participants were significantly better at identifying the models when visualized as 3D scatterplots under rotation than in axis-aligned 2D scatterplots. We provide three point-clouds, both occluded and unoccluded: the Stanford bunny, Utah Teapot, and OSG Cow.

97 MATHEMATICS AND COMPUTING↗

THz Pump and X-Ray Probe Development at LCLS

We report on measurements of broadband, intense, coherent transition radiation at terahertz frequencies, generated as the highly compressed electron bunches in Linear Coherent Light Source (LCLS) pass through a thin metal foil. The foil is inserted at 45{sup o} to the electron beam, 31 m downstream of the undulator. The THz emission passes downward through a diamond window to an optical table below the beamline. A fully compressed 350-pC bunch produces up to 0.5 mJ in a nearly half-cycle pulse of 50 fs FWHM with a spectrum peaking at 10 THz. We estimate a peak field at the focus of over 2.5 GV/m. A 20-fs Ti:sapphire laser oscillator has recently been installed for electro-optic measurements. We are developing plans to add an x-ray probe to this THz pump, by diffracting FEL x rays onto the table with a thin silicon crystal. The x rays would arrive with an adjustable time delay after the THz. This will provide a rapid start to user studies of materials excited by intense single-cycle pulses and will serve as a step toward a THz transport line for LCLS-II.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Future Synchrotron Light Sources Based on Ultimate Storage Rings

The main purpose of this talk is to describe how far one might push the state of the art in storage ring design. The talk will start with an overview of the latest developments and advances in the design of synchrotron light sources based on the concept of an 'ultimate' storage ring. The review will establish how bright a ring based light source might be, where the frontier of technological challenges are, and what the limits of accelerator physics are. Emphasis will be given to possible improvements in accelerator design and developments in technology toward the goal of achieving an ultimate storage ring. An ultimate storage ring (USR), defined as an electron ring-based light source having an emittance in both transverse planes at the diffraction limit for the range of X-ray wavelengths of interest for a scientific community, would provide very high brightness photons having high transverse coherence that would extend the capabilities of X-ray imaging and probe techniques beyond today's performance. It would be a cost-effective, high-coherence 4th generation light source, competitive with one based on energy recovery linac (ERL) technology, serving a large number of users studying material, chemical, and biological sciences. Furthermore, because of the experience accumulated over many decades of ring operation, it would have the great advantage of stability and reliability. In this paper we consider the design of an USR having 10-pm-rad emittance. It is a tremendous challenge to design a storage ring having such an extremely low emittance, a factor of 100 smaller than those in existing light sources, especially such that it has adequate dynamic aperture and beam lifetime. In many ultra-low emittance designs, the injection acceptances are not large enough for accumulation of the electron beam, necessitating on-axis injection where stored electron bunches are completely replaced with newly injected ones. Recently, starting with the MAX-IV 7-bend achromatic cell, we have made significant progress with the design of PEP-X, a USR that would inhabit the decommissioned PEP-II tunnel at SLAC. The enlargement of the dynamic aperture is largely a result of the cancellations of the 4th-order resonances in the 3rd-order achromats and the effective use of lattice optimization programs. In this paper, we will show those cancellations of the 4th-order resonances using an analytical approach based on the exponential Lie operators and the Poisson brackets. Wherever possible, our analytical results will be compared with their numerical counterparts. Using the derived formulae, we will construct 4th-order geometric achromats and use them as modules for the lattice of the PEP-X USR, noting that only geometric terms are canceled to the 4th order.

43 PARTICLE ACCELERATORS↗