Search NASA⌕ Search

SEARCH · Search NASA

Results for “tool evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Computer-Based Tools for Evaluating Graphical User Interfaces

The user interface is the component of a software system that connects two very complex system: humans and computers. Each of these two systems impose certain requirements on the final product. The user is the judge of the usability and utility of the system; the computer software and hardware are the tools with which the interface is constructed. Mistakes are sometimes made in designing and developing user interfaces because the designers and developers have limited knowledge about human performance (e.g., problem solving, decision making, planning, and reasoning). Even those trained in user interface design make mistakes because they are unable to address all of the known requirements and constraints on design. Evaluation of the user inter-face is therefore a critical phase of the user interface development process. Evaluation should not be considered the final phase of design; but it should be part of an iterative design cycle with the output of evaluation being feed back into design. The goal of this research was to develop a set of computer-based tools for objectively evaluating graphical user interfaces. The research was organized into three phases. The first phase resulted in the development of an embedded evaluation tool which evaluates the usability of a graphical user interface based on a user's performance. An expert system to assist in the design and evaluation of user interfaces based upon rules and guidelines was developed during the second phase. During the final phase of the research an automatic layout tool to be used in the initial design of graphical inter- faces was developed. The research was coordinated with NASA Marshall Space Flight Center's Mission Operations Laboratory's efforts in developing onboard payload display specifications for the Space Station.

Moore, Loretta A.↗

A human factors evaluation using tools for automated knowledge engineering

A human factors evaluation of the MH-53J helicopter cockpit is described. This evaluation was an application and futher development of Tools for Automated Knowledge Engineering (TAKE). TAKE is used to acquire and analyze knowledge from domain experts (aircrew members, system designers, maintenance personnel, human factors engineers, or others). TAKE was successfully utilized for the purpose of recommending improvements for the man-machine interfaces (MMI) in the MH-53J cockpit.

Gomes, Marie E.↗

Evaluating modeling tools for the EDOS

The Earth Observing System (EOS) Data and Operations System (EDOS) Project is developing a functional, system performance model to support the system implementation phase of the EDOS which is being designed and built by the Goddard Space Flight Center (GSFC). The EDOS Project will use modeling to meet two key objectives: (1) manage system design impacts introduced by unplanned changed in mission requirements; and (2) evaluate evolutionary technology insertions throughout the development of the EDOS. To select a suitable modeling tool, the EDOS modeling team developed an approach for evaluating modeling tools and languages by deriving evaluation criteria from both the EDOS modeling requirements and the development plan. Essential and optional features for an appropriate modeling tool were identified and compared with known capabilities of several modeling tools. Vendors were also provided the opportunity to model a representative EDOS processing function to demonstrate the applicability of their modeling tool to the EDOS modeling requirements. This paper emphasizes the importance of using a well defined approach for evaluating tools to model complex systems like the EDOS. The results of this evaluation study do not in any way signify the superiority of any one modeling tool since the results will vary with the specific modeling requirements of each project.

Knoble, Gordon↗

Composing Teams with TEAMSTaR Tool for Evaluating and Mitigating Space Team Risk

As NASA sets its sights on more Earth-independent missions, the mission to Mars as a prime example, a team’s composition becomes a critical issue for mitigating the risks of such endeavors. The purpose of this project is to develop and validate TEAMSTaR (Tool for Evaluating And Mitigating Space Team Risks), a team composition decision support system that can be used by mission stakeholders (e.g., mission schedulers, crew members) to predict how a hypothetical team’s social relationships are likely to evolve and influence crew performance over the course of a mission. TEAMSTaR will enable decision makers to evaluate composition scenarios for a set of teams, for single-member replacements, and/or for subsets of teams.

N S Contractor↗

A dynamic systems engineering methodology research study. Phase 2: Evaluating methodologies, tools, and techniques for applicability to NASA's systems projects

A study of NASA's Systems Management Policy (SMP) concluded that the primary methodology being used by the Mission Operations and Data Systems Directorate and its subordinate, the Networks Division, is very effective. Still some unmet needs were identified. This study involved evaluating methodologies, tools, and techniques with the potential for resolving the previously identified deficiencies. Six preselected methodologies being used by other organizations with similar development problems were studied. The study revealed a wide range of significant differences in structure. Each system had some strengths but none will satisfy all of the needs of the Networks Division. Areas for improvement of the methodology being used by the Networks Division are listed with recommendations for specific action.

Paul, Arthur S.↗

General Tool for Evaluating High-Contrast Coronagraphic Telescope Performance Error Budgets

The Coronagraph Performance Error Budget (CPEB) tool automates many of the key steps required to evaluate the scattered starlight contrast in the dark hole of a space-based coronagraph. The tool uses a Code V prescription of the optical train, and uses MATLAB programs to call ray-trace code that generates linear beam-walk and aberration sensitivity matrices for motions of the optical elements and line-of-sight pointing, with and without controlled fine-steering mirrors (FSMs). The sensitivity matrices are imported by macros into Excel 2007, where the error budget is evaluated. The user specifies the particular optics of interest, and chooses the quality of each optic from a predefined set of PSDs. The spreadsheet creates a nominal set of thermal and jitter motions, and combines that with the sensitivity matrices to generate an error budget for the system. CPEB also contains a combination of form and ActiveX controls with Visual Basic for Applications code to allow for user interaction in which the user can perform trade studies such as changing engineering requirements, and identifying and isolating stringent requirements. It contains summary tables and graphics that can be instantly used for reporting results in view graphs. The entire process to obtain a coronagraphic telescope performance error budget has been automated into three stages: conversion of optical prescription from Zemax or Code V to MACOS (in-house optical modeling and analysis tool), a linear models process, and an error budget tool process. The first process was improved by developing a MATLAB package based on the Class Constructor Method with a number of user-defined functions that allow the user to modify the MACOS optical prescription. The second process was modified by creating a MATLAB package that contains user-defined functions that automate the process. The user interfaces with the process by utilizing an initialization file where the user defines the parameters of the linear model computations. Other than this, the process is fully automated. The third process was developed based on the Terrestrial Planet Finder coronagraph Error Budget Tool, but was fully automated by using VBA code, form, and ActiveX controls.

Marchen, Luis F.↗

Developer Tools for Evaluating Multi-Objective Algorithms

Multi-objective algorithms for scheduling offer many advantages over the more conventional single objective approach. By keeping user objectives separate instead of combined, more information is available to the end user to make trade-offs between competing objectives. Unlike single objective algorithms, which produce a single solution, multi-objective algorithms produce a set of solutions, called a Pareto surface, where no solution is strictly dominated by another solution for all objectives. From the end-user perspective a Pareto-surface provides a tool for reasoning about trade-offs between competing objectives. From the perspective of a software developer multi-objective algorithms provide an additional challenge. How can you tell if one multi-objective algorithm is better than another? This paper presents formal and visual tools for evaluating multi-objective algorithms and shows how the developer process of selecting an algorithm parallels the end-user process of selecting a solution for execution out of the Pareto-Surface.

multi-objective optimization↗

Ruggedized Acoustic Tool for High-Temperature Wellbore Integrity Evaluation in Harsh Geothermal Environments [Slides]

This presentation covers the development of a high-temperature well integrity evaluation tool that (1) can operate in high-temperature EGS boreholes to provide consistent, high-resolution evaluation information, (2) can operate without active cooling or substantial mitigation of borehole conditions, and (3) can provide high-fidelity data to adequately characterize conditions that may present safety hazards, risk to the environment, and efficacy of wellbore construction for long-term operation.

15 GEOTHERMAL ENERGY↗

Programming Tools: Status, Evaluation, and Comparison

In this tutorial I will first describe the characteristics of scientific applications and their developers, and describe the computing environment in a typical high-performance computing center. I will define the user requirements for tools that support application portability and present the difficulties to satisfy them. These form the basis of the evaluation and comparison of the tools. I will then describe the tools available in the market and the tools available in the public domain. Specifically, I will describe the tools for converting sequential programs, tools for developing portable new programs, tools for debugging and performance tuning, tools for partitioning and mapping, and tools for managing network of resources. I will introduce the main goals and approaches of the tools, and show main features of a few tools in each category. Meanwhile, I will compare tool usability for real-world application development and compare their different technological approaches. Finally, I will indicate the future directions of the tools in each category.

Cheng, Doreen Y.↗

Experimental and analytical tools for evaluation of Stirling engine rod seal behavior

The first year of a two year experimental and analytical program is reported. The program is directed at the elastohydrodynamic behavior of sliding elastomeric rod seals for the Stirling engine. During the year, experimental and analytical tools were developed for evaluating seal leakage, seal friction, and the fluid film thickness at the seal/cylinder interface.

Krauter, A. I.↗

Simulation-modeling tool for evaluation of space telerobotic control strategies

An object-oriented software graphic simulation and modeling tool is developed to explore human/autonomous control allocation for varied operational scenarios. The system provides designers with LISP workstations through which to simulate telerobotic operations, model human performance in those operations, examine task performance profiles, and investigate control and diagnostic strategies. It is suggested that the provision of such analytic tools along with the presentation of performance projections can assist designers in rapidly and conveniently exploring design alternatives for telerobotic system control.

Corker, Kevin↗

In-Situ Characterization Tools for Evaluating Radiation Tolerance and Elemental Migration in Perovskites

This paper discusses the in-situ characterization tools designed to assess radiation tolerance and elemental migration in perovskite materials. With the increasing use of perovskites in various technological applications, understanding their response to radiation exposure is paramount. Ion Beam Induced Charge (IBIC) emerges as a powerful tool for investigating the radiation tolerance of perovskites at the microscale. By employing focused ion beams, IBIC allows for the spatial mapping of charge carriers, offering insights into the material's electronic response to radiation-induced defects. This technique enables researchers to pinpoint areas of enhanced or suppressed charge collection, providing valuable information on the perovskite's intrinsic properties under irradiation. Rutherford Backscattering Spectrometry (RBS) complements the study by offering a quantitative analysis of elemental migration in perovskite materials. Through the precise measurement of backscattered ions, RBS provides a detailed understanding of the elemental composition and distribution within the perovskite lattice after radiation exposure. The integration of IBIC and RBS techniques in in-situ experiments enhances the comprehensive characterization of radiation effects on perovskites.

ion beams↗

A General Tool for Evaluating High-Contrast Coronagraphic Telescope Performance Error Budgets

This paper describes a general purpose Coronagraph Performance Error Budget (CPEB) tool that we have developed under the NASA Exoplanet Exploration Program. The CPEB automates many of the key steps required to evaluate the scattered starlight contrast in the dark hole of a space-based coronagraph. It operates in 3 steps: first, a CodeV or Zemax prescription is converted into a MACOS optical prescription. Second, a Matlab program calls ray-trace code that generates linear beam-walk and aberration sensitivity matrices for motions of the optical elements and line-of-sight pointing, with and without controlled coarse and fine-steering mirrors. Third, the sensitivity matrices are imported by macros into Excel 2007 where the error budget is created. Once created, the user specifies the quality of each optic from a predefined set of PSDs. The spreadsheet creates a nominal set of thermal and jitter motions and combines them with the sensitivity matrices to generate an error budget for the system. The user can easily modify the motion allocations to perform trade studies.

Terrestrial Planet Finder↗

Flexible Technoeconomic Analysis Tools for Evaluating Emerging Power Generation Technologies in Hourly Electricity Markets using IDAES and Pyomo

Conference presentation leveraging the recently developed “price-taker class”. We use the tool to develop and showcase workflows that enable rapid technology evaluation for power generation technologies. This work shows a reimplementation of previous results that were conducted outside the price-taker class framework, indicating this workflow is indeed streamlining emerging technology analysis.

Laky, Daniel↗

Multi-modal virtual environment research at Armstrong Laboratory

One mission of the Paul M. Fitts Human Engineering Division of Armstrong Laboratory is to improve the user interface for complex systems through user-centered exploratory development and research activities. In support of this goal, many current projects attempt to advance and exploit user-interface concepts made possible by virtual reality (VR) technologies. Virtual environments may be used as a general purpose interface medium, an alternative display/control method, a data visualization and analysis tool, or a graphically based performance assessment tool. An overview is given of research projects within the division on prototype interface hardware/software development, integrated interface concept development, interface design and evaluation tool development, and user and mission performance evaluation tool development.

Eggleston, Robert G.↗

An Analytical Tool to Evaluate Defect Thermodynamics of (La,Ba)Fe1-xMxO3-δ Perovskites for Solid-Oxide Cell Applications

A modeling tool of the defect thermodynamics of (La,Ba)Fe1-xMxO3-δ perovskites which includes energetic information about oxygen vacancy formation, hydration, hydride formation, and charge disproportionation reactions has been developed1. This tool incorporates defect energies and entropies expressed as sixth order polynomial functions to allow refinements of the defect reaction equilibrium constants in the thermodynamic analysis. Calculation of (La,Ba)Fe1-xMxO3-δ Brouwer diagrams as a function of pO2/pH2O and pH2/H2O in a range of temperatures of interest is facilitated by this modeling tool. The results obtained can provide direct guidance how the electronic and ionic defect concentrations of the triple conducting perovskite materials can be used to optimize performance of solid oxide cells for energy applications. The impact of magnetic and electronic structures of the perovskites on the defect reaction energies and entropies as obtained from density function theory modeling and the role played by hydride defect species will also be discussed.

Lee, Yueh-Lin↗

TRMM Common Microphysics Products: A Tool for Evaluating Spaceborne Precipitation Retrieval Algorithms

A customized product for analysis of microphysics data collected from aircraft during field campaigns in support of the TRMM program is described. These Common Microphysics Products (CMP's) are designed to aid in evaluation of TRMM spaceborne precipitation retrieval algorithms. Information needed for this purpose (e.g., particle size spectra and habit, liquid and ice water content) was derived using a common processing strategy on the wide variety of microphysical instruments and raw native data formats employed in the field campaigns. The CMP's are organized into an ASCII structure to allow easy access to the data for those less familiar with and without the tools to accomplish microphysical data processing. Detailed examples of the CMP show its potential and some of its limitations. This approach may be a first step toward developing a generalized microphysics format and an associated community-oriented, non-proprietary software package for microphysics data processing, initiatives that would likely broaden community access to and use of microphysics datasets.

Kingsmill, David E.↗