SEARCH · Search NASA

Results for “usability evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

NASA NTRS1974

Utilizing ERTS imagery to detect plant diseases and nutrient deficiencies, soil types and soil moisture levels

The author has identified the following significant results. ERTS-1 imagery may be used to delineate soil associations. It does have the capacity to divide soils into groups such that their land use and management would be similar. It offers definite potential for making grass flood-plain, wetland, river shoreline, and land use change surveys. Production of volume strata and forest type from the two usable bands of ERTS-1 imagery were of questionable value. No imagery was received for evaluation during the time of year when maine dwarf mosaic virus and southern corn leaf blight were active.

Parks, W. L.↗

NASA NTRS1996

Independent Verification and Validation of Complex User Interfaces: A Human Factors Approach

The Usability Testing and Analysis Facility (UTAF) at the NASA Johnson Space Center has identified and evaluated a potential automated software interface inspection tool capable of assessing the degree to which space-related critical and high-risk software system user interfaces meet objective human factors standards across each NASA program and project. Testing consisted of two distinct phases. Phase 1 compared analysis times and similarity of results for the automated tool and for human-computer interface (HCI) experts. In Phase 2, HCI experts critiqued the prototype tool's user interface. Based on this evaluation, it appears that a more fully developed version of the tool will be a promising complement to a human factors-oriented independent verification and validation (IV&V) process.

Whitmore, Mihriban↗

DOE OSTI2025

Detecting Process Equipment Failures Using Acoustic Data and Machine Learning

Nuclear power plant (NPP) process equipment such as fans, motors, valves, and pumps generate frequent or continuous noise, and deviations from the normal operational sounds made by this equipment can indicate potential issues. These deviations can be identified via automated acoustic anomaly detection, which involves using acoustic sensors (i.e., microphones) alongside detection algorithms to continuously monitor for changes in acoustic signatures. This task is made challenging by the substantial background noise that exists, such as operators opening and closing doors, manipulating valves, and conversing—in addition to typical plant noises. In collaboration with a nuclear power utility partner, this effort assessed the efficacy of acoustic anomaly detection when using a specific acoustic sensor that compresses data into a fixed set of features that are transferable over a standard Internet of Things communication protocol, thereby improving usability but potentially degrading detection performance. Two methods of performing automated acoustic anomaly detection were evaluated: one-class support vector machine (OC-SVM) and isolation forest (iForest). To enable the use of high-quality acoustic data encompassing both normal and anomalous conditions, the study utilized the publicly available Malfunctioning Industrial Machine Investigation and Inspection dataset, which includes real measured acoustic sensor data for a range of equipment types, model numbers, and signal-to-noise ratios (SNRs), along with a benchmark set of detection results. Using this dataset, the methods were tested and then compared against the benchmark results. The results indicated that although the specific acoustic sensor did not enable as rich a feature set extraction, the proposed methods with the limited feature set performed just as well. This provides solid justification for both the methods and the use of the proposed acoustic sensor.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

NASA NTRS2000

AVHRR-Based Polar Pathfinder Products: Evaluation, Enhancement and Transition to MODIS

Study of the environment has historically been done with observations and measurements in relatively few local areas. While some of these have been done over long time spans, most have not. The NOAA/NASA Pathfinder project was initiated to complement these data sets with satellite data that can provide information over larger spatial areas and longer time spans. The AVHRR Polar Pathfinder (APR) program was part of this project. The APR was to supply data from the NOAA AVHRR instruments that was consistently generated in a format usable to a wide range of scientific investigators. A grant was obtained from the NASA Research Announcement 97-MTPE-03 to evaluate the APP products, to provide any enhancements, and to compare with products from the new MODIS instrument. There was about a two year overlap between the projects, and this validation effort had several impacts on the APP products. The APP products are derived from the instruments aboard 4 NOAA satellites, NOAA-7, 9, 11, and 14. Initial validation efforts compared the thermal calibrations of these instruments, and differences are found. Calibration has undergone many revisions and techniques have changed since the satellites were launched. The first calibration methods were optimized for global ocean temperatures, as this was one of the primary and important uses of the AVHRR instruments. As the APP program started, newer methods that provided more accurate temperature retrievals over a wider range of temperatures were being developed. The calibration of a wider range of temperatures were necessary because of the extremely low values in the polar regions. These methods were also designed so that calibrated data was also consistent between all the NOAA satellites. These newer calibration methods were then adopted primarily because of the initial finding of this validation effort.

Fowler, Charles↗

NASA NTRS1974

Development of potassium ion conducting hollow glass fibers

Potassium ion conducting glasses, chemically resistant to potassium, potassium sulfide and sulfur, were made and their possible utility as the membrane material for a potassium/sulfur battery was evaluated. At least one satisfactory candidate was found. It possesses an electrical resistance which makes it usable as a membrane in the form of a fine hollow fiber. It's chemical and electrochemical resistances are excellent. The other aspects of the possible potassium sulfur battery utilizing such fine hollow fibers, including the header (or tube sheet) and a cathode current collector were studied. Several cathode materials were found to be satisfactory. None of the tube sheet materials studied possessed all the desired properties. Multi-fiber cells had very limited life-time due to physical failure of fibers at the fiber/tube sheet junctions.

Tsang, F. Y.↗

NASA NTRS2014

Effect of Control System Augmentation on Handling Qualities and Task Performance in Good and Degraded Visual Environments

In June 2013, NASA and the U.S. Army jointly conducted a simulation experiment in the NASA-Ames Vertical Motion Simulator that examined and quantified the effects of limited-authority control system augmentation on handling qualities and task performance in both good and degraded visual environments (DVEs). The vehicle model used for the experiment was the OH-58D with similar size, weight and performance, and the same 4-blade rotor system as the Bell 407 civilian helicopter that is commonly used for medical evacuation and emergency medical services. The control systems investigated as part of this study included the baseline aircraft Rate Command system, a short-term Attitude Command/Attitude Hold system that uses lagged-rate feedback to provide a short-term attitude response, Modernized Control Laws that provide an Attitude Command/Attitude Hold control response type, and Modernized Control Laws with an additional Position Hold function. Evaluation tasks included the ADS-33 Hover, Sidestep, Acceleration/Deceleration, and Pirouette Mission Task Elements, as well as a new proposed Emergency Medical Services task that includes an approach and landing at a minimally prepared remote landing site. Degraded visual environments were simulated with night vision goggles and an unaided night scene. A total of nine experimental test pilots participated in the four-week simulation experiment. Data recorded during the evaluation included Cooper-Harper handling qualities ratings, Bedford Workload scale ratings, and task performance. The Usable Cue Environment (UCE) was measured for this simulation experiment, and found to be UCE equals 1 in good visual environments and UCE equals 2 in degraded visual environments with night vision goggles. Results showed that handling qualities ratings were improved with a control system providing short-term attitude response over a rate command system, although the improvements were not sufficient to produce Level 1 handling qualities in degraded visual environments. Results for an Attitude Command/Attitude Hold control system showed that borderline Level 1 handling qualities could be achieved in degraded visual environments, and the 10 percent authority stability augmentation system was adequate to obtain these handling qualities ratings.

Handling Qualities↗

NASA NTRS2019

Sense and Avoid Characterization of the Independent Configurable Architecture for Reliable Operations of Unmanned Systems

Abstract—Independent Configurable Architecture for Reliable Operations of Unmanned Systems (ICAROUS) is a distributed software architecture developed by NASA Langley Research Center to enable safe autonomous UAS operations. ICAROUS consists of a collection formally verified core algorithms for path planning, traffic avoidance, geofence handling, and decision making that interface with an autopilot system through a publisher-subscriber middleware. The ICAROUS Sense and Avoid Characterization (ISAAC) test was designed to evaluate the performance of the onboard Sense and Avoid (SAA) capability to detect potential conflicts with other aircraft and autonomously maneuver to avoid collisions, while remaining within the airspace boundaries of the mission. The ISAAC tests evaluated the impact of separation distances and alerting times on SAA performance. A preliminary analysis of the effects of each parameter on key measures of performance is conducted, informing the choice of appropriate parameter values for different small Unmanned Aircraft Systems (sUAS) applications. Furthermore, low-power Automatic Dependent Surveillance – Broadcast (ADS-B) is evaluated for potential use to enable autonomous sUAS to sUAS deconflictions as well as to provide usable warnings for manned aircraft without saturating the frequency spectrum.

Consiglio, Maria↗

NASA NTRSDate not supplied

pyQuARC: Open Source Library for Earth Observation Metadata Quality Assessment

Metadata quality is essential to effective data discovery and has become increasingly vital as more Earth Science data sets become available. The Common Metadata Repository (CMR) hosts metadata describing NASA’s Earth Observation data products, which are archived across 12 Distributed Active Archive Centers (DAACs). The Analysis and Review of CMR (ARC) Team, located at Marshall Space Flight Center, conducts metadata quality assessments to ensure that these data products are discoverable, accessible, and usable. To achieve these goals, the ARC team has developed a metadata quality assessment framework to evaluate metadata completeness, correctness, and consistency. ARC uses a combination of manual and automated methods to assess these three components and identify areas of improvement; the team then collaborates with the DAACs to resolve any findings. To streamline this process, ARC is currently developing a host of scripts, known as pyQuARC, to automate metadata quality assessments as much as possible. pyQuARC is an open source library for Earth Observation Metadata Quality Assessment, and the tool utilizes ARC’s metadata quality assessment framework to make basic validation checks, pinpoint inconsistencies between dataset-level (i.e. collection) and file-level (i.e. granule) metadata, and identify opportunities for more descriptive and robust information. Since pyQuARC is also customizable, other users can make modifications as needed, and future metadata standards can also be implemented. Once pyQuARC is fully developed, it will support multiple schema types to serve the broader EOSDIS metadata community. This presentation will provide an overview of pyQuARC and its process of development while showcasing the tool’s valuable features and uses.

Jenny Wood↗

NASA NTRS2004

Innovative Imagery System for Enhanced Habitability Onboard ISS: Desired Features and Possible Hardware Applications

With the advent of the ISS and the experience of Russian, European, and US crewmembers on Mir, the importance of the psychological element in long duration missions is increasingly recognized. An integrated imagery system or Magic Window System could enhance the habitability, performance, and productivity for long term stays in space. Because this is type of system is a new concept for space, functional and technical requirements need to be determined. As part of a three-year project, the functional and technical requirements for an Imagery System onboard the International Space Station (ISS) have been explored. Valuable information was gathered from a survey completed by participants that had been in analog environments (remote/isolated) such as Antarctica, Aquarius, ISS crewmember debriefs, and crew support meetings to identify key functions desired for an integrated Magic Window System. Exercise and medical care activities were identified as areas that could benefit from such a system. It was determined that for exercise, it was worth exploring the concept of displaying a dynamic screen that changes as the crewmember's speed changes while showing physiological measures in a combined display. In terms of enhancing the interfaces for medical care activities, the Magic Window System could show video clips along side procedures for just-in-time training scenarios through a heads-up display. In addition, the portability, usability, and reliability were stressed as important considerations for an integrated system of technologies or Magic Window System. In addition, a review of state-of-the-art screens and other existing technologies such as tablet PCs and Personal Digital Assistants (PDAs) was conducted and contributed to defining technical requirements and feasibility of systems. Some heuristic evaluations of large displays and PDAs were conducted. Finally, feasibility for implementation onboard ISS has been considered. Currently, specific headset units are undergoing usability testing. The outcome of these activities will be valuable to determine the best candidates for an integrated system that could accommodate different needs depending on task.

Whitmore, Mihriban↗

NASA NTRSDate not supplied

Usability of Pre-Flight Planning Interfaces for Supplemental Data Service Provider Tools to Support Uncrewed Aircraft System Traffic Management

Small uncrewed aircraft systems (sUASs) operate in low-altitude, uncontrolled airspace – where support services for their operators (UASOs) are not currently provided. NASA’s System-Wide Safety (SWS) project is identifying the potential risks and hazards to sUAS operations to provide, inform, and improve the designs of In-time Aviation Safety Management Systems (IASMS). The IASMS will include a suite of data-driven tools that compile and analyze data collected from aviation systems and environmental sources to predict hazards, and provide information to allow operators to mitigate these risks (Young et al., 2020). These risk and hazard services can be run and displayed to operators on graphical user interfaces (GUIs), as they relate to a vehicle(s)’ route of flight. These interfaces offer both a means to present hazard service output and offer an opportunity to test user understanding of the information, user decision making, and the best ways to present such data to an operator. Based on these future technologies and intended missions, it is important to investigate interface requirements and evaluate how operators might use these tools. Presenting salient and meaningful risk assessment information to operators is necessary to increase situation awareness and ultimately safety. Building on previous research (Feldman et al., 2022), a usability study comparing two GUIs was conducted to explore how individuals interacted with different styles of information displays. A series of pre-flight hazard and risk-assessment tasks were developed to evaluate participant performance using the Supplemental Data Service Provider Consolidated Dashboard and the Human Automation Team Interface System interfaces. Participants were trained to use both GUIs and their performance was analysed across different scenarios involving multiple sUASs. Performance on simple tasks and the System Usability Scale scores were reported by Feldman et al., 2023. Additional analyses and evaluations on more complex tasks (e.g., risk assessment, prioritization), workload and response times are examined in this paper.

sUAV interfaces↗

NASA NTRSDate not supplied

Usability of Pre-flight Planning Interfaces for Supplemental Data Service Provider Tools to Support Uncrewed Aircraft System Traffic Management

sUAV interfaces↗

NASA NTRS2013

An Evaluation of Operational Airspace Sectorization Integrated System (OASIS) Advisory Tool

In January 2013, a human-in-the-loop evaluation of the Operational Airspace Sectorization Integrated System (OASIS) was conducted in the Airspace Operations Laboratory of the Human Systems Integration Division (Code TH) in conjunction with the Aviation Systems Division (Code AF). The development of OASIS is a major activity of the Dynamic Airspace Configuration (DAC) research focus area within the Aeronautics Research Mission Directorate (ARMD) Airspace Systems Program. OASIS is an advisory tool to assist Federal Aviation Administration (FAA) En Route Area Supervisors in their planning of sector combinedecombine operations as well as opening closing of Data-side (D-side) control positions. These advisory solutions are tailored to the predicted traffic demand over the next few hours. During the experiment, eight retired FAA personnel served as participants for a part-task evaluation of OASIS functionality, covering the user interface as well as the underlying algorithm. Participants gave positive feedback on both the user interface and the algorithm solutions for airspace configuration, including an excellent average rating of 94 on the tool usability scales. They also suggested various enhancements to the OASIS tool, which will be incorporated into the next tool development cycle for the full-scale human-in-the-loop evaluation to be conducted later this year.

decision support tools↗

NASA NTRS1989

Gravimetric measurements of materials outgassing applied to graphite-epoxy laminates

The outgassing rates of two graphite-epoxy laminates, American Cyanamide 985B-626 and HST-7B-112, were obtained using a gravimetric method. The rates as a function of time and temperature were derived from the measurements of their mass losses at temperatures varying from 25 to 150 C and for a time span of up to 400 hours in a vacuum. The data from those measurements were reduced to obtain the outgassing activation energies, the mass losses per unit mass or area, and the corresponding outgassing rates. The rates are expressed in closed-form equations and are directly usable for medling computations. The procedures to obtain these parameters are shown and may be used for the evaluation of other materials. The results of the tests show that the activation energies of the two materials are: 4630 cal/mole for the 985B-626 materials and 4791 cal/mole for the HST-7B-112 sample no. 10 Graphite Exoxy. The outgassing rates of these materials are in the 10E-5 g/sq cm/hr range and they decay according to a power of time of 0.60 at 25 C, indicating that the outgassing process is mainly a diffusion at that temperature. The normalized mass losses versus time obtained from these tests were compared to the discrete results obtained from the ASTM-E595 tests. The comparison provides general indications on the effects of temperature and time in relation to the ASTM test values obtained at 125 C for a 24-hour test duration.

Scialdone, John J.↗

NASA NTRS1990

Gravimetric measurements of materials outgassing applied to graphite-epoxy laminates

The outgassing rates of two graphite-epoxy laminates, American Cyanamide 985B-626 and HST-7B-112, were obtained using a gravimetric method. The rates as a function of time and temperature were derived from the measurements of their mass losses at temperatures varying from 25 to 150 C and for a time span of up to 400 hours in a vacuum. The data from those measurements were reduced to obtain the outgassing activation energies, the mass losses per unit mass or area, and the corresponding outgassing rates. The rates are expressed in closed-form equations and are directly usable for modeling computations. The procedures to obtain these parameters are shown and may be used for the evaluation of other materials. The results of the tests show that the activation energies of the two materials are: 4630 cal/mole for the 985B-626 materials and 4791 cal/mole for the HST-7B-112 sample no. 10 Graphite Epoxy. The outgassing rates of these materials are in the 1OE-5 g sq cm/hr range and they decay according to a power of time of 0.60 at 25 C, indicating that the outgassing process is mainly a diffusion at that temperature. The normalized mass losses versus time obtained from these tests were compared to the discrete results obtained from the ASTM-E595 tests. The comparison provides general indications on the effects of temperature and time in relation to the ASTM test values obtained at 125 C for a 24-hour test duration.

Scialdone, John J.↗

DOE OSTI2026

Beyond Contrast Transfer: Spectral SNR as a Finite-Dose Metric for STEM Phase Retrieval

The contrast transfer function (CTF) is widely used to evaluate phase retrieval methods in scanning transmission electron microscopy (STEM), including center-of-mass imaging, parallax imaging, direct ptychography, and iterative ptychography. However, the CTF reflects only the maximum usable signal, neglecting the effects of finite electron fluence and the Poisson-limited nature of detection. As a result, it can significantly overestimate practical performance, especially in low-dose regimes. Here, we employ the spectral signal-to-noise ratio (SSNR), as a finite-dose statistical framework to evaluate the recoverable signal as a function of spatial frequency. Using numerical reconstructions of white-noise objects, we show that center-of-mass, parallax, and direct ptychography exhibit dose-independent SSNRs, with close-form analytic expressions. In contrast, iterative ptychography exhibits a surprising dose dependence: at low fluence, its SSNR converges to that of direct ptychography; at high fluence, it saturates at a value consistent with the maximum detective quantum efficiency predicted by recent quantum Fisher information bounds. The results highlight the limitations of CTF-based evaluation and motivate SSNR as a more accurate, finite-dose metric for assessing STEM phase retrieval methods.

STEM phase retrieval↗

NASA NTRS1984

Design criteria for a PC-based common user interface to remote information systems

A set of design criteria are presented which will allow the implementation of an interface to multiple remote information systems on a microcomputer. The focus of the design description is on providing the user with the functionality required to retrieve, store and manipulate data residing in remote information systems through the utilization of a standardized interface system. The intent is to spare the user from learning the details of retrieval from specific systems while retaining the full capabilities of each system. The system design includes multi-level capabilities to enhance usability by a wide range of users and utilizes microcomputer graphics capabilities where applicable. A data collection subsystem for evaluation purposes is also described.

Dominick, Wayne D.↗

NASA NTRSDate not supplied

QuARC: Development of a Service to Enable FAIR-er Metadata

The ARC Project: The ARC Team located at NASA’s Marshall Space Flight Center conducts quality assessments of metadata records that catalog NASA’s collection of over 9,000 Earth observation data products, stored in a centralized database called the Common Metadata Repository (CMR). The ARC Team has developed a metadata quality assessment framework to evaluate metadata completeness, correctness, and consistency with the goal of making NASA’s data products more discoverable, accessible, and usable. ARC = Analysis and Review of the CMR

Earth Science Informatics↗

NASA NTRS2005

Apex Reference Manual 3.0 Beta

Apex is a toolkit for constructing software that behaves intelligently and responsively in demanding task environments. Reflecting its origin at NASA where Apex continues to be developed, current applications include: a) Providing autonomous mission management and tactical control capabilities for unmanned aerial vehicles including an autonomous surveillance helicopter and a simulation prototype of an unmanned fixed-wing aircraft to be used for wildfire mapping; b) Simulating human air traffic controllers, pilots and astronauts to help predict how people might respond to changes in equipment or procedures; and c) Predicting the precise duration and sequence of routine human behaviors based on a human-computer interaction engineering technique called CPM-GOMS. Among Apex s components are a set of implemented reasoning services, such as those for reactive planning and temporal pattern recognition; a software architecture that embeds and integrates these services and allows additional reasoning elements to be added as extensions; a formal language for specifying agent knowledge; a simulation environment to facilitate prototyping and analysis; and Sherpa, a set of tools for visualizing autonomy logic and runtime behavior. In combination, these are meant to provide a flexible and usable framework for creating, testing, and deploying intelligent agent software. Overall, our goal in developing Apex is to lower economic barriers to developing intelligent software agents. New ideas about how to extend or modify the system are evaluated in terms of their impact in reducing the time, expertise, and inventiveness required to build and maintain applications. For example, potential enhancements to the AI reasoning capabilities in the system are reviewed not only for usefulness and distinctiveness, but also for their impact on the readability and general usability of Apex s behavior representation language (PDL) and on the transparency of resulting behavior. A second central part of our approach is to iteratively refine Apex based on lessons learned from as diverse a set of applications as possible. Many applications have been developed by users outside the core development team including engineers, researchers, and students. Usability is thus a central concern for every aspect of Apex visible to a user, including PDL, Sherpa, the Apex installation process, APIs, and user documentation. Apex users vary in their areas of expertise and in their familiarity with autonomy technology. Focusing on usability, a development philosophy summarized by the project motto "Usable Autonomy," has been important part of enabling diverse users to employ Apex successfully and to provide feedback needed to guide iterative, user-centered refinement.

Freed, Michael A.↗