Search NASA⌕ Search

SEARCH · Search NASA

Results for “User evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2004

User Evaluation of the NASA Technical Report Server Recommendation Service

We present the user evaluation of two recommendation server methodologies implemented for the NASA Technical Report Server (NTRS). One methodology for generating recommendations uses log analysis to identify co-retrieval events on full-text documents. For comparison, we used the Vector Space Model (VSM) as the second methodology. We calculated cosine similarities and used the top 10 most similar documents (based on metadata) as 'recommendations'. We then ran an experiment with NASA Langley Research Center (LaRC) staff members to gather their feedback on which method produced the most 'quality' recommendations. We found that in most cases VSM outperformed log analysis of co-retrievals. However, analyzing the data revealed the evaluations may have been structurally biased in favor of the VSM generated recommendations. We explore some possible methods for combining log analysis and VSM generated recommendations and suggest areas of future work.

Nelson, Michael L.↗
NASA NTRS2004

User Evaluation of the NASA Technical Report Server Recommendation Service

We present the user evaluation of two recommendation server methodologies implemented for the NASA Technical Report Server (NTRS). One methodology for generating recommendations uses log analysis to identify co-retrieval events on full-text documents. For comparison, we used the Vector Space Model (VSM) as the second methodology. We calculated cosine similarities and used the top 10 most similar documents (based on metadata) as recommendations . We then ran an experiment with NASA Langley Research Center (LaRC) staff members to gather their feedback on which method produced the most quality recommendations. We found that in most cases VSM outperformed log analysis of co-retrievals. However, analyzing the data revealed the evaluations may have been structurally biased in favor of the VSM generated recommendations. We explore some possible methods for combining log analysis and VSM generated recommendations and suggest areas of future work.

Nelson, Michael L.↗
NASA NTRS1975

CARETS: A prototype regional environmental information system. Volume 12: User evaluation of experimental land use maps and related products from the central Atlantic test site

The user interaction and evaluation phase of the USGS/NASA Central Atlantic Regional Ecological Test Site was designed to obtain the input of local, regional, State, and Federal agency users of land-resource information into the development, of a regional information system; to provide users with assistance and data resulting from CARETS research; and to have user. organizations evaluate to what extent the CARETS products meet their needs. The evaluation of CARETS land use and related products revealed that most user agencies interviewed, at all governmental levels, require more detailed data than that provided by the CARETS project. Few agencies found utility in the generalized ERTS Level I land--use maps. Level II data, though reported valuable by several users, was generally considered of secondary utility by most users. The products considered most useful by users at all levels were the high--altitude color-infrared photographs and the USGS orthophotoquads. Recommendations resulting from the evaluation reflect the need to establish a flexible and reliable system for providing more detailed raw and processed land-resource information as well as the need to improve the methods of making information available to users.

Land-use planning↗
NASA NTRS1976

Scheduling algorithm for mission planning and logistics evaluation users' guide

The scheduling algorithm for mission planning and logistics evaluation (SAMPLE) program is a mission planning tool composed of three subsystems; the mission payloads subsystem (MPLS), which generates a list of feasible combinations from a payload model for a given calendar year; GREEDY, which is a heuristic model used to find the best traffic model; and the operations simulation and resources scheduling subsystem (OSARS), which determines traffic model feasibility for available resources. The SAMPLE provides the user with options to allow the execution of MPLS, GREEDY, GREEDY-OSARS, or MPLS-GREEDY-OSARS.

Chang, H.↗
NASA NTRS1987

User evaluation of photovoltaic-powered vaccine refrigerator/freezer systems

The NASA Lewis Research Center has concluded a project to develop and field test photovoltaic-powered refrigerator/freezers for vaccine storage in remote areas of developing countries. As a conclusion to this project, questionnaires were sent to the in-country administrators for each test site probing user acceptance of the systems and attitudes regarding procurement of additional systems. Responses indicate that the systems had a positive effect on the local communities, that they made a positive impression on the local health authorities, and that system cost and scarcity of funds are the major barriers to procurements of additional systems.

Ratajczak, Anthony F.↗
NASA NTRS1981

A users evaluation of SAMIS

SAMIS, the Solar Array Manufacturing Industry Simulation computer program was developed by Jet Propulsion Laboratories (JPL) to provide a method whereby manufacturers or potential manufacturers of photovoltaics could simulate a solar industry using their own particular approach. This paper analyzes the usefulness of SAMIS to a growing photovoltaic industry and clearly illustrates its limitations as viewed by an industrial user.

Grenon, L. A.↗
DOE OSTI2025

Evaluating User Errors and Temporal Trends in Marine Fish Communities Using 360-Degree Underwater Photography

The use of environmental DNA (eDNA) sampling has been proposed as a complementary method to monitor fish species in marine environments, offering a non-invasive and potentially more efficient approach to marine species observations. eDNA monitoring could be especially useful in and around sites targeted for marine energy generation as these regions need regular monitoring that would be impractical with traditional techniques. Before we can fully rely upon eDNA, we must first verify its accuracy against other proven methods, such as the use of underwater photography. In this study, I deployed a 360-degree camera in the tidal channel of Sequim Bay once a month during several hours overlapping slack tide. I investigated how having multiple people identify and count fish on underwater images could affect the overall results. Using chi square tests in R, I compared my fish identifications and counts to those made by another intern on the same images recorded in August. I found significant differences in the number of species identified and the total individual counts between the two different datasets. I also tested the statistical differences in both Shannon diversity and Pielou evenness indices between the August, September, and November camera deployments using a Hutcheson t-test. Only one significant difference was found in the Shannon index comparisons, and none were found between the Pielou evenness comparisons. These findings show that if multiple identifiers are used to process underwater images, quality control checks must be made to reduce the potential for error. This also points toward the possibility to leverage more advanced image analysis processes, such as automated image analysis software. The findings from this study also show that the dynamics of marine fish communities can vary over a few months; however, further analysis is needed to determine the extent of the seasonal changes in Sequim Bay.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1976

User evaluation of ride technology research

The 23 organizations queried represent government, carrier, and manufacturing interests in air, marine, rail, and surface transportation systems. Results indicate a strong need for common terminology and data analysis/reporting techniques. The various types of ride criteria currently in use are discussed, particularly in terms of their respective data base requirements. A plan of action is proposed for fulfilling the ride technology needs identified by this study.

Mckenzie, J. R.↗
NASA NTRS1997

Computer-Based Tools for Evaluating Graphical User Interfaces

The user interface is the component of a software system that connects two very complex system: humans and computers. Each of these two systems impose certain requirements on the final product. The user is the judge of the usability and utility of the system; the computer software and hardware are the tools with which the interface is constructed. Mistakes are sometimes made in designing and developing user interfaces because the designers and developers have limited knowledge about human performance (e.g., problem solving, decision making, planning, and reasoning). Even those trained in user interface design make mistakes because they are unable to address all of the known requirements and constraints on design. Evaluation of the user inter-face is therefore a critical phase of the user interface development process. Evaluation should not be considered the final phase of design; but it should be part of an iterative design cycle with the output of evaluation being feed back into design. The goal of this research was to develop a set of computer-based tools for objectively evaluating graphical user interfaces. The research was organized into three phases. The first phase resulted in the development of an embedded evaluation tool which evaluates the usability of a graphical user interface based on a user's performance. An expert system to assist in the design and evaluation of user interfaces based upon rules and guidelines was developed during the second phase. During the final phase of the research an automatic layout tool to be used in the initial design of graphical inter- faces was developed. The research was coordinated with NASA Marshall Space Flight Center's Mission Operations Laboratory's efforts in developing onboard payload display specifications for the Space Station.

Moore, Loretta A.↗
NASA NTRS1986

A methodology for the design and evaluation of user interfaces for interactive information systems

The definition of proposed research addressing the development and validation of a methodology for the design and evaluation of user interfaces for interactive information systems is given. The major objectives of this research are: the development of a comprehensive, objective, and generalizable methodology for the design and evaluation of user interfaces for information systems; the development of equations and/or analytical models to characterize user behavior and the performance of a designed interface; the design of a prototype system for the development and administration of user interfaces; and the design and use of controlled experiments to support the research and test/validate the proposed methodology. The proposed design methodology views the user interface as a virtual machine composed of three layers: an interactive layer, a dialogue manager layer, and an application interface layer. A command language model of user system interactions is presented because of its inherent simplicity and structured approach based on interaction events. All interaction events have a common structure based on common generic elements necessary for a successful dialogue. It is shown that, using this model, various types of interfaces could be designed and implemented to accommodate various categories of users. The implementation methodology is discussed in terms of how to store and organize the information.

Dominick, Wayne D.↗
NASA NTRS2011

Materials and Nondestructive Evaluation Laboratoriers: User Test Planning Guide

The Materials and Nondestructive Evaluation Laboratory process, milestones and inputs are unknowns to first-time users. The Materials and Nondestructive Evaluation Laboratory Planning Guide aids in establishing expectations for both NASA and non- NASA facility customers. The potential audience for this guide includes both internal and commercial spaceflight hardware developers. It is intended to assist their project engineering personnel in materials analysis planning and execution. Material covered includes a roadmap of the analysis process, roles and responsibilities of facility and user, major milestones, facility capabilities, and inputs required by the facility. Samples of deliverables, products, and inputs necessary to define scope of analysis, cost, and schedule are included as an appendix to the guide.

Schaschl, Leslie↗
NASA NTRSDate not supplied

Evaluation of User Experience of Self-Scheduling Software for Astronauts: Defining a Satisfaction Baseline

As NASA turns its sights to deep-space exploration, a greater focus on sup-porting crew autonomy has led to the development of Playbook, a self-scheduling software tool. Evaluating the user satisfaction of Playbook is essential in ensuring its usability for critical spaceflight operations. Satisfaction of an interface is often quantified with attitude surveys, such as the User Experience Questionnaire (UEQ). This paper demonstrates an application of the UEQ in comparing the user experience of Playbook interface de-signs for displaying graphical data. We lay the foundation for future user experience comparisons by defining a satisfaction baseline, which is crucial as more features are integrated into Playbook’s interface. This work ex-tends a validated user experience framework into a spaceflight domain, allowing optimization of human-computer interaction as future operational tools are developed.

user experience↗
DOE OSTI2023

Visualization Quality Assessment

Understanding how inaccuracies in visualizations affect users’ perception and understanding of scientific data is hard. Inaccuracies in visualizations are quite common and could arise from a range of sources such as errors in the original dataset arising from compression artifacts, errors in the capturing device, noise during transmission of the data, effects due to the algorithm being used to convert data to visualization images, images generated from neural networks, and sources we have yet to discover. Many image quality assessment metrics have been developed to quantify image errors. However, these are usually focused on “natural images” rather than visualizations of scientific data. Common image quality assessment metrics (IQAs) include MSE, PSNR, perceptual metrics such SSIM, FSIM as well as perceptual metrics using deep learning approaches. However, a critical part of understanding how errors are perceived by humans, and subsequently developing more accurate quality assessment metrics, is through user evaluation studies. The goal of this software is to develop a visualization quality assessment (VQA) process that will enable the generation of VQAs that can be used to quantify errors in scientific data visualizations. The VQA development process will include software to support user evaluation experimental design, analysis of visualization differences against standard quality metrics, and the ability to develop additional VQA metrics specific to scientific visualization images.

Grosset, Andre↗
NASA NTRS1982

Resolution versus speckle relative to geologic interpretability of spaceborne radar images - A survey of user preference

A survey conducted to evaluate user preference for resolution versus speckle relative to the geologic interpretability of spaceborne radar images is discussed. Thirteen different resolution/looks combinations are simulated from Seasat synthetic-aperture radar data of each of three test sites. The SAR images were distributed with questionnaires for analysis to 85 earth scientists. The relative discriminability of geologic targets at each test site for each simulation of resolution and speckle on the images is determined on the basis of a survey of the evaluations. A large majority of the analysts respond that for most targets a two-look image at the highest simulated resolution is best. For a constant data rate, a higher resolution is more important for target discrimination than a higher number of looks. It is noted that sand dunes require more looks than other geologic targets. At all resolutions, multiple-look images are preferred over the corresponding single-look image. In general, the number of multiple looks that is optimal for discriminating geologic targets is inversely related to the simulated resolution.

Ford, J. P.↗