Search NASA⌕ Search

SEARCH · Search NASA

Results for “usability evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Developing a Dashboard Interface to Display Assessment of Hazards and Risks to sUAS Flights

The Supplemental Data Services Provider-Consolidated Dashboard (SDSP-CD) is a graphical user interface (GUI) that displays the results of predictive tools in a single location. It is intended to be used in the prefight planning phase of an operation to allow users to proactively assess predicted flight hazards off-line; expanding an operator’s overall situational awareness of a flight plan and providing an opportunity for decision making and assessing the associated risks prior to flight. Hazard data and risk predictions are informative but can be complex to read and understand. However, presented visually and in relation to flight parameters (such as flight path), the nature and significance of hazards become much more evident. The SDSP-Consolidation Dashboard interface was designed to offer a means to present the results of hazard services in an easy to-use format. Two usability studies were run to explore what features might make a suite of hazard assessment services easy to use, and to assess the SDSP-CD interface. The first study evaluated the presentation of information on the GUI and the second evaluated users’ ability to understand and use the information. The studies gathered valuable information about how users approach a hazard assessment task and interpret information from the interface. Many suggestions were given for improving the interface’s information display, to allow users to more quickly understand and interpret the information being presented

UAV display↗

Playbook Data Analysis Tool: Collecting Interaction Data from Extremely Remote Users

Typically, user tests for software tools are conducted in person. At NASA, the users may be located at the bottom of the ocean in a pressurized habitat, above the atmosphere in the International Space Station, or in an isolated capsule on a simulated asteroid mission. The Playbook Data Analysis Tool (P-DAT) is a human-computer interaction (HCI) evaluation tool that the NASA Ames HCI Group has developed to record user interactions with Playbook, the group's existing planning-and-execution software application. Once the remotely collected user interaction data makes its way back to Earth, researchers can use P-DAT for in-depth analysis. Since a critical component of the Playbook project is to understand how to develop more intuitive software tools for astronauts to plan in space, P-DAT helps guide us in the development of additional easy-to-use features for Playbook, informing the design of future crew autonomy tools.P-DAT has demonstrated the capability of discreetly capturing usability data in amanner that is transparent to Playbook’s end-users. In our experience, P-DAT data hasalready shown its utility, revealing potential usability patterns, helping diagnose softwarebugs, and identifying metrics and events that are pertinent to Playbook usage aswell as spaceflight operations. As we continue to develop this analysis tool, P-DATmay yet provide a method for long-duration, unobtrusive human performance collectionand evaluation for mission controllers back on Earth and researchers investigatingthe effects and mitigations related to future human spaceflight performance.

in-flight monitoring↗

"Do That Again": Evaluating Spoken Dialogue Interfaces

We present a new technique for evaluating spoken dialogue interfaces that allows us to separate the dialogue behavior from the rest of the speech system. By using a dialogue simulator that we have developed, we can gather usability data on the system s dialogue interaction and behaviors that can guide improvements to the speech interface. Preliminary testing has shown promising results, suggesting that it is possible to test properties of dialogue separately from other factors such as recognition quality.

James, Frankie↗

Automated image processing of LANDSAT 2 digital data for watershed runoff prediction

The U.S. Soil Conservation Service (SCS) model for watershed runoff prediction uses soil and land cover information as its major drivers. Kern County Water Agency is implementing the SCS model to predict runoff for 10,400 sq cm of mountainous watershed in Kern County, California. The Remote Sensing Unit, University of California, Santa Barbara, was commissioned by KCWA to conduct a 230 sq cm feasibility study in the Lake Isabella, California region to evaluate remote sensing methodologies which could be ultimately extrapolated to the entire 10,400 sq cm Kern County watershed. Digital results indicate that digital image processing of Landsat 2 data will provide usable land cover required by KCWA for input to the SCS runoff model.

Sasso, R. R.↗

Evaluation of APREQCFR Coordination Procedures for Charlotte Douglas International Airport

NASA has been collaborating with the Federal Aviation Administration (FAA) and aviation industry partners to develop and demonstrate new concepts and technologies for the Integrated Arrival, Departure, and Surface (IADS) traffic management capabilities under the Airspace Technology Demonstration 2 (ATD-2) project. One of the goal of The IADS capabilities in the ATD-2 project is to increase predictability and increase throughput via improving TMI compliance. The IADS capabilities that will impact TMI compliance are built upon previous NASA research, the Precision Departure Release Capability (PDRC). The proposed paper will evaluate the APREQCFR process between ATC Tower and Center and information sharing between ATC Tower and the airline Ramp tower. Subjective measures collected from the HITL surveys (e.g., workload, situational awareness, acceptability, usability) and performance metrics such as TMI, TMAT, and pushback advisory compliance from APREQCFR flights and will be reported.

APREQ scheduling↗

Evaluating Descent and Ascent Trajectories Near Non-Spherical Bodies

Spacecraft landing on small bodies pass through regions where conventional gravitation formulations using exterior spherical harmonics are inaccurate. An investigation shows that a formulation using interior solid spherical harmonics might be satisfactory. Interior spherical harmonic expansions are usable inside an imaginary, empty sphere. For this application, such a sphere could be positioned in empty space above the intended landing site and rotating with the body. When the spacecraft is inside this sphere, the interior harmonic expansion would be used instead of the conventional, exterior harmonic expansion. Coefficients can be determined by a least-squares fit to gravitation measurements synthesized from conventional formulations. Due to their unfamiliarity, recurrences for interior, as well as exterior, expansions are derived. Hotine's technique for partial derivatives of exterior spherical harmonics is extended to interior harmonics.

Werner, Robert A.↗

The Development of a User Inclusion Strategy for CLCS Display Design

This report summarizes a ten week effort to evaluate the software development process in the Checkout and Launch Control System (CLCS) for the presence of user inclusion in the design operation. A background is presented that highlights the value of achieving usability through user inclusion, progress-to-date is described, and future work is suggested so that a user inclusive design environment can be accomplished.

Jacko, Julie A.↗

Application of the H-Mode, a Design and Interaction Concept for Highly Automated Vehicles, to Aircraft

Driven by increased safety, efficiency, and airspace capacity, automation is playing an increasing role in aircraft operations. As aircraft become increasingly able to autonomously respond to a range of situations with performance surpassing human operators, we are compelled to look for new methods that help us understand their use and guide their design using new forms of automation and interaction. We propose a novel design metaphor to aid the conceptualization, design, and operation of highly-automated aircraft. Design metaphors transfer meaning from common experiences to less familiar applications or functions. A notable example is the "Desktop metaphor" for manipulating files on a computer. This paper describes a metaphor for highly automated vehicles known as the H-metaphor and a specific embodiment of the metaphor known as the H-mode as applied to aircraft. The fundamentals of the H-metaphor are reviewed followed by an overview of an exploratory usability study investigating human-automation interaction issues for a simple H-mode implementation. The envisioned application of the H-mode concept to aircraft is then described as are two planned evaluations.

Goodrich, Kenneth H.↗

Thermophysical property data and safety information

Precision measurements of the properties of oxygen over a wide range of temperature and pressure are complete. The primary remaining effort, which is in progress, is the representation of these data in the most usable format such as tables, equations, diagrams, and computer programs. In addition, safety data are essential to proper design, operation, and failure analysis. All of the available information on oxygen safety is being reviewed, evaluated and indexed for quick retrieval through the NASA Aerospace Safety Research and Data Institute program. The availability of data, where the major gaps in data occur, and retrieval of bibliographic information are discussed.

Kropschot, R. H.↗

TASAR Certification and Operational Approval Requirements - Analyses and Results

This report documents the results of research and development work performed by Rockwell Collins in addressing the Task 1 objectives under NASA Contract NNL12AA11C. Under this contract Rockwell Collins provided analytical support to the NASA Langley Research Center (LaRC) in NASA's development of a Traffic Aware Strategic Aircrew Requests (TASAR) flight deck Electronic Flight Bag (EFB) application for technology transition into operational use. The two primary objectives of this contract were for Rockwell Collins and the University of Iowa OPL to 1) perform an implementation assessment of TASAR toward early certification and operational approval of TASAR as an EFB application (Task 1 of this contract), and 2) design, develop and conduct two Human-in-the-Loop (HITL) simulation experiments that evaluate TASAR and the associated Traffic Aware Planner (TAP) software application to determine the situational awareness and workload impacts of TASAR in the flight deck, while also assessing the level of comprehension, usefulness, and usability of the features of TAP (Task 2 of this contract). This report represents the Task 1 summary report. The Task 2 summary report is provided in [0].

Koczo, Stefan, Jr.↗

Analysis of radiation and meteoroid satellite data

The data obtained in earth orbit by the Radiation and Meteoroid Satellite (RMS) were interpreted and reduced to a form which will be usable by future space experimenters. The required tasks are detailed. Computer programs were written which lifted the raw data and associated emphemeris data from the GFE magnetic tapes. The engineering data was then used to evaluate the performance of the spacecraft and the experiments. The radiation data was used to prepare flux, spectral, and dose maps of the South Atlantic magnetic anomaly where possible. The meteoroid data was used to determine a rough estimate of the meteoroid flux and in general evaluate the performance of the thin-film meteoroid sensors. The degree of success of the RMS mission was evaluated in light of the separation anomaly which occurred between RMS and OFO during launch.

Farmer, B. J.↗

A Framework for Assessing Earth Observation Metadata Quality: Implications for Data Discovery and Open Science

The Common Metadata Repository (CMR) contains metadata records describing NASA’s collection of over 8,000 Earth observation data products. The Analysis and Review of CMR (ARC) Team at Marshall Space Flight Center assesses the quality of these metadata records. Metadata, rather than the data itself, is indexed for search in both discipline-specific datacenters and global or aggregated catalogs (such as Earth data Search), making it essential for determining whether a data product is appropriate for a given research question or application need. Since metadata connects users to data, it should be as accurate and complete as possible in addition to meeting minimum database requirements. The ARC team has developed a metadata quality framework by which to assess quality. The framework consists of a set of quality criteria that converge around the dimensions of correctness, completeness, and consistency, with the goal of improving the discoverability, accessibility, and usability of NASA’s Earth Observation data. The application of the framework has resulted in a measurable improvement in NASA’s metadata quality. Key aspects of the framework’s success are the ability to systematically evaluate metadata and provide actionable quality improvement recommendations. Lessons learned from the project will be shared along with implementation details which may be relevant to other science disciplines. By aiming to make data more discoverable and accessible to a broad user community, the ARC metadata quality framework helps contribute to NASA’s commitment to open science.

Jeanne Le Roux↗

Innovations in Spacecraft Proximity & Navigation Lighting

New spacecraft bound for the Moon and Mars should be exploring lighting technologies that can reduce safety risks while increasing capability. The operational lighting environment for these new missions will not have the forgiving 90 minute orbit of the International Space Station. Advances in solid state lighting and optics design are yielding new form factors for lamps that have the potential to reduce operational risk for both humans and imaging systems that are impacted by high contrast lighting environments. This project evaluated light source form factors and control innovations for spacecraft exterior proximity and navigation lighting by building a demonstration test rig and testing the effectiveness of the light sources and their controls to increase visibility and usability.

Clark, Toni A.↗

A Parametric Battery Model for the Conceptual Design of Electric Aircraft

Electric aircraft conceptual designs usually have an assumed specific power and specific energy for the aircraft’s energy storage system that dictates the total capacity and the peak power available. The specific energy and power are inherently linked to the state-of-charge and discharge rate from which they were derived; therefore, they will not directly correspond to the diverse circumstances encountered in various aircraft missions and flight segments. These parameters turn the battery system into a black box, disregard potential electrical restrictions, and disallow the aircraft and battery to be optimized as a system. Peering into this box, this study highlights the importance of incorporating a parametric battery model into the conceptual design workflow by splitting high-level terms such as power into voltage and current and investigating their variability during the discharge process. Through the modeling of these more detailed parameters, this methodology shows the feasibility of using low states-of-charge for contingency operations, including the end of the reserve mission, expanding the amount of usable capacity for electric aircraft. Stark differences in aircraft capabilities can arise between varying fidelity battery models due to late-mission, high-power flight operations. This parametric battery model effectively captures these differences by evaluating the limitations that arise within the individual battery cells and the aircraft powertrain. This paper shows that the unusable charge of a battery is set by the balked landing power requirement and can realistically range from 5% to 44% based on assumptions. This sets the analog to unusable fuel capacity in aircraft with liquid fuel systems. Needing only aircraft- and mission-level inputs and only seconds of run time, this model is a prime fit for the fast, accurate exploration of the electric aircraft conceptual design space.

Battery↗

Beware of agents when flying aircraft: Basic principles behind a generic methodology for the evaluation and certification of advanced aviation systems

There is currently a growing interest in the aeronautical community to assess the effects of the increasing levels of automation on pilots' performance and overall safety. The first effect of automation is the change in the nature of the pilot's role on the flight deck. Pilots have become supervisors who monitor aircraft systems in usual situations and intervene only when unanticipated events occur. Instead of 'hand flying' the airplane, pilots contribute to the control of aircraft by acting as mediators, instructions given to the automation. By eliminating the need for manually controlling normal situations, such a role division has reduced the opportunities for the pilot to acquire experience and skills necessary to safely cope with abnormal events. Difficulties in assessing the state and behavior of automation arise mainly from four factors: (1) the complexity of current systems and consequence mode-related problems; (2) the intrinsic autonomy of automation which is able to fire mode transitions without explicit commands from the pilots; (3) the bad quality of feed-back from the control systems displays and interfaces to the pilots; and (4) the fact that the automation currently has no explicit representation of the current pilots' intentions and strategy. Assuming certification has among its major goals to guarantee the passengers' and pilots' safety and the airplane integrity under normal and abnormal operational conditions, the authors suggest it would be particularly fruitful to come up with a conceptual reference system providing the certification authorities both with a theoretical framework and a list of principles usable for assessing the quality of the equipment and designs under examination. This is precisely the scope of this paper. However, the authors recognize that the conceptual presented is still under development and would thus be best considered as a source of reflection for the design, evaluation and certification processes of advanced aviation technologies.

Javaux, Denis↗

Strategies for Enhancing Battery Life Under Fast Charging: Insights from NMC-Based Cell Cycling

Fast charging improves the usability of consumer electronics and electric vehicles (EVs) by reducing range anxiety and downtime but accelerates battery degradation and raises safety concerns. Optimizing operational conditions during fast-charging is critical to mitigating aging and ensuring safety. This study evaluated multilayer Gr/NMC811 cells under various conditions, including depths of discharge (DODs of 68%, 84%, and 100%), upper charge cutoff voltages (4.1–4.2 V), and post-charge rest periods (2–30 min), using a 20 min fast charging protocol for up to 500 cycles (up to 150,000 miles of EV use assuming 3.3 mi/kWh vehicle level energy efficiency). Surprisingly, higher DODs under fast charging improved battery life and performance compared to lower DODs. Reducing the upper charge cut-off voltage helped mitigate degradation. A brief 2 min rest period after charging further reduced aging effects. The primary aging modes were loss of lithium inventory and cathode active material. Although minor lithium plating was observed within 500 cycles, it did not affect performance significantly. These findings suggest that, with optimized conditions, cells can sustain hundreds of fast charge cycles—equivalent to over 100,000 miles of EV use—without significant adverse effects on performance or longevity.

25 - ENERGY STORAGE↗

Investigation of new hypergol scrubber technology

The ultimate goal of this work is to minimize the liquid waste generated from the scrubbing of hypergolic vent gases. In particular, nitrogen tetroxide, a strong oxidizer used in hypergolic propellant systems, is currently scrubbed with a sodium hydroxide solution resulting in a hazardous liquid waste. This study investigated the use of a solution of potassium hydroxide and hydrogen peroxide for the nitrogen textroxide vent scrubber system. The potassium nitrate formed would be potentially usable as a fertilizer. The hydrogen peroxide is added to convert the potassium nitrite that is formed into more potassium nitrate. Smallscale laboratory tests were conducted to establish the stability of hydrogen peroxide in the proposed scrubbing solution and to evaluate the effectiveness of hydrogen peroxide in converting nitrite to nitrate.

Glasscock, Barbara H.↗

Determining Desirable Cursor Control Device Characteristics for NASA Exploration Missions

The Crew Exploration Vehicle (CEV) that will travel to the moon and Mars, and all future Exploration vehicles and habitats will be highly computerized, necessitating an accurate method of interaction with the computers. The design of a cursor control device will have to take into consideration g-forces, vibration, gloved operations, and the specific types of tasks to be performed. The study described here is being undertaken to begin identifying characteristics of cursor control devices that will work well for the unique Exploration mission environments. The objective of the study is not to identify a particular device, but to begin identifying design characteristics that are usable and desirable for space missions. Most cursor control devices have strengths and weaknesses; they are more appropriate for some tasks and less suitable for others. The purpose of this study is to collect some initial usability data on a large number of commercially available and proprietary cursor control devices. A software test battery was developed for this purpose. Once data has been collected using these low-level, basic point/click/drag tasks, higher fidelity, scenario-driven evaluations will be conducted with a reduced set of devices. The standard tasks used for testing cursor control devices are based on a model of human movement known as Fitts law. Fitts law predicts that the time to acquire a target is logarithmically related to the distance over the target size. To gather data for analysis with this law, fundamental, low-level tasks are used such as dragging or pointing at various targets of different sizes from various distances. The first four core tasks for the study were based on the ISO 9241-9:(2000) document from the International Organization for Standardization that contains the requirements for non-keyboard input devices. These include two pointing tasks, one dragging and one tracking task. The fifth task from ISO 9241-9, the circular tracking task was not used because it is a movement that is not applicable to most of the applications used on aviation displays. Additionally, we opted to add a multi-size and multi-distance pointing task, and two ecologically more valid tasks which included text selection, and interaction with drop down menus, sliders, and checkboxes. The Visual Basic test battery tracks the task and trial numbers, measures the pointing, tracking or dragging time, as well as the number and types of errors. The testing session includes a practice set for each input device, then the randomized 7 tasks, and finally a questionnaire about the device. This is repeated for all the devices tested within a session. The experiment is a within-subjects design, with participants returning for multiple sessions to test additional devices. The input devices will be compared based on objective performance data from the tasks, as well as subjective feedback and ratings on the questionnaire.

Aniko Sandor↗