Search NASA⌕ Search

SEARCH · Search NASA

Results for “user study”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Analyzing Task-Based User Study Data to Determine Colormap Efficiency

Domain scientists use colormaps to visualize their data. These are useful for identifying areas of interest including Eddy Identification and Characterizing Currents. New colormaps have been designed by visual artist Francesca Samsel. User studies have been implemented to determine whether or not these colormaps are an improvement.

97 MATHEMATICS AND COMPUTING↗

Initial User Study Insights Clarified Community Requirements & Early Feedback on Conceptual Design

The HPDF User Experience (UX) team conducted eight semi-structured interviews with twelve individuals leading data and computing infrastructure work at DOE Office of Science (SC) user facilities or projects. This report presents key takeaways synthesizing community perspectives and needs, along with recommendations for the project. These insights should be considered as conceptual design work continues, early partnerships begin, workflow readiness activities evaluate and enhance key scientific tools, and early access systems are made available to the Office of Science (SC) community. Vigilance in meeting community requirements and ensuring workflow readiness will be needed to ensure HPDF’s success.

97 MATHEMATICS AND COMPUTING↗

Analyzing task-based user study data to determine colormap efficiency

Domain scientists need colormaps to visualize their data and are especially useful for identifying areas of interest, like in ocean data to identify eddies or characterize currents. However, traditional Rainbow colormap performs poorly for understanding details, because of the small perceptual range. In order to assist domain scientists in recognizing and identifying important details in their data, different colormaps need to be applied to allow higher perceptual definition. Visual artist Francesca Samsel used her understanding of color theory to create new colormaps to improve perception. While domain scientists find the new colormaps to be useful, we implemented a rigorous and quantitative study to determine whether or not the new colormaps have perceptually more colors. Color count data from one of these studies will be analyzed in depth in order to determine whether or not the new colormaps have more perceivable colors and what affects the number of perceivable colors.

97 MATHEMATICS AND COMPUTING↗

Storage Sizing and Placement Simulation: Quick-Start Case Study User’s Guide

The Storage Sizing and Placement Simulation (SSIM) application allows a user to define the possible sizes and locations of energy storage elements on an existing grid model defined in OpenDSS. Given these possibilities, the software will automatically search through them and attempt to determine which configurations result in the best overall grid performance. This quick-start guide will go through, in detail, the creation of an SSIM model based on a modified version of the IEEE 34 bus test feeder system. There are two primary parts of this document. The first is a complete list of instructions with little-to-no explanation of the meanings of the actions requested. The second is a detailed description of each input and action stating the intent and effect of each. There are links between the two sections.

25 ENERGY STORAGE↗

Developing Guidelines for Assessing Visual Analytics Environments

Visual analytic systems can be evaluated from a user perspective with quantitative metrics (i.e., time to complete the analysis or the accuracy of the solution found). However, qualitative measures are also useful in a user assessment. These include such measures as the utility of the interactive visualizations in the analysis process and the user's assessment of the efficiency of the analytic process. Quantitative measures can be found if data sets with embedded ground truth are used for analysis. Qualitative measures are more elusive. In this paper we report on an experiment with professional analysts who ranked five of submissions to the VAST 2009 Challenge and provided the rationale for their rankings. Their comments were used in conjunction with a meta-analysis of the 2009 VAST Challenge reviews to produce a set of guidelines for visual analytic systems. As visual analytic software is expected to eventually help in all aspects of analysis, we expect to see future systems provide more help with generating the final report. Hence, researchers also need to have an understanding of what makes a good analytic product. Therefore we asked the analysts to rank the situational assessments of four grand challenge entries and to provide comments on those assessments. We used these comments to produce guidelines for researchers to use in evaluating their analytic reports.

99 GENERAL AND MISCELLANEOUS↗

A Pipeline for Large Data Processing Using Regular Sampling for Unstructured Grids

Large simulation data requires a lot of time and computational resources to compute, store, analyze, visualize, and run user studies. Today, the largest cost of a supercomputer is not hardware but maintenance, in particular energy consumption. Our goal is to balance energy consumption and cognitive value of visualizations of resulting data. This requires us to go through the entire processing pipeline, from simulation to user studies. To reduce the amount of resources, data can be sampled or compressed. While this adds more computation time, the computational overhead is negligible compared to the simulation time. We built a processing pipeline at the example of regular sampling. The reasons for this choice are two-fold: using a simple example reduces unnecessary complexity as we know what to expect from the results. Furthermore, it provides a good baseline for future, more elaborate sampling methods. We measured time and energy for each test we did, and we conducted user studies in Amazon Mechanical Turk (AMT) for a range of different results we produced through sampling.

97 MATHEMATICS AND COMPUTING↗

Pooled Rideshare in the U.S.: An Exploratory Study of User Preferences

Pooled ridesharing offers on-demand, one-way, cost-effective transportation for passengers traveling in similar directions via a shared vehicle ride with others they do not know. Despite its potential benefits, the adoption of pooled rideshare remains low in the United States. This exploratory study aims to evaluate potential service improvements and features that may increase users’ willingness to adopt the service. The study analyzed transportation behaviors, rideshare preferences, and willingness to adopt pooled rideshare services among 8296 U.S. participants in 2025, building on findings from a 2021 nationwide survey of 5385 U.S. participants. The study incorporated 77 actionable items developed from the results of the 2021 survey to assess whether addressing specific user-generated topics such as safety, reliability, convenience, and privacy can improve pooled rideshare use. A side-by-side comparison of the 2021 and 2025 data revealed shifts in transportation behavior, with personal rideshare usage increasing from 22% to 28%, public transportation from 21% to 27%, and pooled rideshare from 6% to 8%, while personal vehicle (79%) use remained dominant. Participants rated features such as driver verification (94%), vehicle information (93%), peak time reliability (93%), and saving time and money (92–93%) as most important for improving rideshare services. A pre-to-post analysis of willingness to use pooled rideshare utilizing the actionable items as per respondents’ preferences showed improvement: “definitely will” increased from 15.9% to 20.1% and “probably will” rose from 35.6% to 47.7%. These results suggest that well-targeted service improvements may meaningfully enhance pooled rideshare acceptance. This study offers practical guidance for Transportation Network Companies (TNCs) and policymakers aiming to improve pooled rideshare as well as potential future research opportunities.

Transportation Network Companies (TNCs)↗

Operational Analytics Studies for ATLAS Distributed Computing: Data Popularity Forecast and Utilization of the WLCG Centers

Operational analytics is the direction of research related to the analysis of the current state of computing processes and the prediction of future states in order to anticipate imbalances and take timely measures to stabilize a complex system. There are two relevant areas in ATLAS Distributed Computing that are currently the focus of studies: user physics analysis including the forecast of popularity of data samples among users, and evaluating WLCG centers for their readiness to process user analysis payloads. Studying these areas is challenging due to the complexity involved, as it requires a comprehensive understanding of numerous boundary conditions typically found in large-scale distributed computing infrastructures. Forecasts of data popularity are problematic without the categorization of user tasks by their types (data transformation or physics analysis), which do not always appear on the surface but may induce noise, which introduces significant distortions for predictive analysis. Evaluating the WLCG resources by their analysis workloads is also a challenging task as it is necessary to find a balance between the workload of the resource, its performance, the waiting time for jobs on it, as well as the volume of jobs that it processes. This is especially difficult in a heterogeneous computing environment, where legacy resources are used along with modern high-performance machines. We will look at these areas of research in detail and discuss what tools and methods are used in our work, demonstrating results already obtained.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Empirical Analysis of the Subjective Impressions and Objective Measures of Domain Scientists’ Visual Analytic Judgments

Scientists often use specific data analysis and presentation methods familiar within their domain. But does high familiarity drive better analytical judgment? This question is especially relevant when familiar methods themselves can have shortcomings: many visualizations used conventionally for scientific data analysis and presentation do not follow established best practices. This necessitates new methods that might be unfamiliar yet prove to be more effective. But there is little empirical understanding of the relationships between scientists’ subjective impressions about familiar and unfamiliar visualizations and objective measures of their visual analytic judgments. To address this gap and to study these factors, we focus on visualizations used for comparison of climate model performance. We report on a comprehensive survey-based user study with 47 climate scientists and present an analysis of : i) relationships among scientists’ familiarity, their perceived lev- els of comfort, confidence, accuracy, and objective measures of accuracy, and ii) relationships among domain experience, visualization familiarity, and post-study preference.

Dasgupta, Aritra↗

Example-Based Automatic Music-Driven Conventional Dance Motion Synthesis

We introduce a novel method for synthesizing dance motions that follow the emotions and contents of a piece of music. Our method employs a learning-based approach to model the music to motion mapping relationship embodied in example dance motions along with those motions' accompanying background music. A key step in our method is to train a music to motion matching quality rating function through learning the music to motion mapping relationship exhibited in synchronized music and dance motion data, which were captured from professional human dance performance. To generate an optimal sequence of dance motion segments to match with a piece of music, we introduce a constraint-based dynamic programming procedure. This procedure considers both music to motion matching quality and visual smoothness of a resultant dance motion sequence. We also introduce a two-way evaluation strategy, coupled with a GPU-based implementation, through which we can execute the dynamic programming process in parallel, resulting in significant speedup. To evaluate the effectiveness of our method, we quantitatively compare the dance motions synthesized by our method with motion synthesis results by several peer methods using the motions captured from professional human dancers' performance as the gold standard. We also conducted several medium-scale user studies to explore how perceptually our dance motion synthesis method can outperform existing methods in synthesizing dance motions to match with a piece of music. These user studies produced very positive results on our music-driven dance motion synthesis experiments for several Asian dance genres, confirming the advantages of our method.

99 GENERAL AND MISCELLANEOUS↗

Intelligent Manufacturing Support: Specialized LLMs for Composite Material Processing and Equipment Operation

Engineering educational curriculum and standards cover many material and manufacturing options. However, engineers and designers are often unfamiliar with certain composite materials or manufacturing techniques. Large language models (LLMs) could potentially bridge the gap. Their capacity to store and retrieve data from large databases provides them with a breadth of knowledge across disciplines. However, their generalized knowledge base can lack targeted, industry-specific knowledge. To this end, we present two LLM-based applications based on the GPT-4 architecture: (1) The Composites Guide: a system that provides expert knowledge on composites material and connects users with research and industry professionals who can provide additional support and (2) The Equipment Assistant: a system that provides guidance for manufacturing tool operation and material characterization. By combining the knowledge of general AI models with industry-specific knowledge, both applications are intended to provide more meaningful information for engineers. In this paper, we discuss the development of the applications and evaluate it through a benchmark and two informal user studies. The benchmark analysis uses the Rouge and Bertscore metrics to evaluate our models’ performance against GPT-4o. The results show that GPT-4o and the proposed models perform similarly or better on the ROUGE and BERTScore metrics. The two user studies supplement this quantitative evaluation by asking experts to provide qualitative and open-ended feedback about our model’s performance on a set of domain-specific questions. The results of both studies highlight a potential for more detailed and specific responses with the Composites Guide and the Equipment Assistant.

Kapoor, Gunnika [Oak Ridge National Laboratory (OR↗

Digital Radiography and Computed Tomography (DRCT) Product Improvement Plan (PIP)

The Idaho National Laboratory (INL) has been developing and deploying x-ray inspection systems for chemical weapons containers for the past 12 years under the direction of the Project Manager for Non-Stockpile Chemical Materiel (PMNSCM). In FY-10 funding was provided to advance the capabilities of these systems through the DRCT (Digital Radiography and Computed Tomography) Product Improvement Plan (PIP), funded by the PMNSCM. The DRCT PIP identified three research tasks; end user study, detector evaluation and DRCT/PINS integration. Work commenced in February, 2010. Due to the late start and the schedule for field inspection of munitions at various sites, it was not possible to spend sufficient field time with operators to develop a complete end user study. We were able to interact with several operators, principally Mr. Mike Rowan who provided substantial useful input through several discussions and development of a set of field notes from the Pueblo, CO field mission. We will be pursuing ongoing interactions with field personnel as opportunities arise in FY-11.

99 GENERAL AND MISCELLANEOUS↗

Immersive Particle Advection: Through the Scales of Renewable Energy: Preprint

We describe the benefits of immersive flow analysis for three large-scale computational science studies in the field of renewable energy. The studies encompass a range of scales, spanning from the large atmospheric scale of a wind farm to the human scale of an electric vehicle cabin down to the microscopic scale of battery material science. In these studies, users explored the flow patterns and dynamics through immersive particle advection. The integration of high-performance computing with immersive analysis provided a deeper understanding of these systems, helping develop more effective solutions for a sustainable energy future.

computational fluid dynamics↗

Factors Influencing Adoption of Pooled Rideshare An Explorative Study on User-Centered Design and Services

The rise of real-time information communication through smartphones and wireless networks enabled the growth of ridesharing services. While personal rideshare services (individuals ride alone or with people they know) initially dominated the market, the popularity of pooled ridesharing (individuals share rides with strangers) has grown globally. However, pooled rideshare remains less common in the U.S., where personal vehicle usage is still the norm. Vehicle design and rideshare services may need to be tailored to user preferences to increase pooled rideshare adoption. A national U.S. survey ( N = 5,385) used exploratory and confirmatory factor analyses to identify four key factors influencing riders’ willingness to consider pooled rideshare: comfort/ease of use, convenience, vehicle technology/accessibility, and passenger safety. Understanding and implementing these user-centered design principles and service-related factors may be critical for increasing the future use of pooled rideshare services

Gangadharaiah, Rakesh↗

Building Energy Information Systems: User Case Studies

Measured energy performance data are essential to national efforts to improve building efficiency, as evidenced in recent benchmarking mandates, and in a growing body of work that indicates the value of permanent monitoring and energy information feedback. This paper presents case studies of energy information systems (EIS) at four enterprises and university campuses, focusing on the attained energy savings, and successes and challenges in technology use and integration. EIS are broadly defined as performance monitoring software, data acquisition hardware, and communication systems to store, analyze and display building energy information. Case investigations showed that the most common energy savings and instances of waste concerned scheduling errors, measurement and verification, and inefficient operations. Data quality is critical to effective EIS use, and is most challenging at the subsystem or component level, and with non-electric energy sources. Sophisticated prediction algorithms may not be well understood but can be applied quite effectively, and sites with custom benchmark models or metrics are more likely to perform analyses external to the EIS. Finally, resources and staffing were identified as a universal challenge, indicating a need to identify additional models of EIS use that extend beyond exclusive in-house use, to analysis services.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Using Machine Learning in Adversarial Environments

Cyber defense is an asymmetric battle today. We need to understand better what options are available for providing defenders with possible advantages. Our project combines machine learning, optimization, and game theory to obscure our defensive posture from the information the adversaries are able to observe. The main conceptual contribution of this research is to separate the problem of prediction, for which machine learning is used, and the problem of computing optimal operational decisions based on such predictions, coupled with a model of adversarial response. This research includes modeling of the attacker and defender, formulation of useful optimization models for studying adversarial interactions, and user studies to measure the impact of the modeling approaches in realistic settings.

97 MATHEMATICS AND COMPUTING↗

Building Energy Information Systems: State of the Technology and User Case Studies

The focus of this study is energy information systems, broadly defined as performance monitoring software, data acquisition hardware, and communication systems used to store, analyze, and display building energy data. At a minimum, an EIS provides hourly whole-building electric data that are web-accessible, with analytical and graphical capabilities. Time series data from meters, sensors, and external data streams are used to perofmr analysis such as baselining, benchmarking, building level anomaly detection, and energy performance tracking.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗