Search NASA⌕ Search

SEARCH · Search NASA

Results for “tool evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Image Navigation and Registration Performance Assessment Evaluation Tools for GOES-R ABI and GLM

The GOES-R Flight Project has developed an Image Navigation and Registration (INR) Performance Assessment Tool Set (IPATS) for measuring Advanced Baseline Imager (ABI) and Geostationary Lightning Mapper (GLM) INR performance metrics in the post-launch period for performance evaluation and long term monitoring. IPATS utilizes a modular algorithmic design to allow user selection of data processing sequences optimized for generation of each INR metric. This novel modular approach minimizes duplication of common processing elements, thereby maximizing code efficiency and speed. Fast processing is essential given the large number of sub-image registrations required to generate INR metrics for the many images produced over a 24 hour evaluation period. This paper describes the software design and implementation of IPATS and provides preliminary test results.

Image registration↗

Image Navigation and Registration Performance Assessment Evaluation Tools for GOES-R ABI and GLM

The GOES-R Flight Project has developed an Image Navigation and Registration (INR) Performance Assessment Tool Set (IPATS) for measuring Advanced Baseline Imager (ABI) and Geostationary Lightning Mapper (GLM) INR performance metrics in the post-launch period for performance evaluation and long term monitoring. IPATS utilizes a modular algorithmic design to allow user selection of data processing sequences optimized for generation of each INR metric. This novel modular approach minimizes duplication of common processing elements, thereby maximizing code efficiency and speed. Fast processing is essential given the large number of sub-image registrations required to generate INR metrics for the many images produced over a 24 hour evaluation period. This paper describes the software design and implementation of IPATS and provides preliminary test results.

image registration↗

Fe(3): An Evaluation Tool for Low-Altitude Air Traffic Operations

The concepts of unmanned aircraft system traffic management (UTM) and urban air mobility (UAM) are introducing high-density operations in low altitude airspace in closer proximity to populated areas than conventional high-altitude air traffic. The Flexible engine for Fast-time Evaluation of Flight Environments (Fe (sup 3)) provides the capability of statistically analyzing the high-density, high-fidelity, and low-altitude traffic system under numerous scenarios, such that stake holders can study impacts of factors in the low-altitude high-density traffic system and define requirements, policies, and protocols needed to support a safe yet efficient traffic system, and even assess operational risks and optimize flight schedules without conducting infeasible and cost-prohibitive flight tests that involve a large volume of aerial vehicles. This work provides an introduction to this simulation tool including its architecture and various models involved. Its performance and sample application in UAM and UTM are also presented.

Collision Avoidance↗

Fe3: An Evaluation Tool for Low-Altitude Air Traffic Operations

The concepts of unmanned aircraft system traffic management (UTM) and urban air mobility (UAM) are introducing high-density operations in low altitude airspace in closer proximity to populated areas than conventional high-altitude air traffic. The Flexible engine for Fast-time Evaluation of Flight Environments (Fe (sup 3)) provides the capability of statistically analyzing the high-density, high-fidelity, and low-altitude traffic system under numerous scenarios, such that stake holders can study impacts of factors in the low-altitude high-density traffic system and define requirements, policies, and protocols needed to support a safe yet efficient traffic system, and even assess operational risks and optimize flight schedules without conducting infeasible and cost-prohibitive flight tests that involve a large volume of aerial vehicles. This work provides an introduction to this simulation tool including its architecture and various models involved. Its performance and sample application in UAM and UTM are also presented.

Trajectory Modeling↗

Problem Reporting Taxonomy and Data Preparation Tool Evaluation

A member of the NASA Engineering and Safety Center (NESC) Systems Engineering Office (SEO) Technical Discipline Team (TDT) requested a SEO-managed activity to perform a gap analysis on the proposed NASA Standard 0006, "Common NASA Taxonomy for Problem Reporting, Analysis, and Resolution", and to create an input filter and set of instructions for using the data-mining/data-cleansing tool TechOasis1 with Space Shuttle Program (SSP) problem reporting data. The work that achieved these objectives and deployment of TechOasis are discussed in this report.

Beil, Robert J.↗

Provisions for nonintrusive flow-evaluation tools in the National Transonic Facility

The national transonic facility fan driven, closed circuit, continuous flow, pressurized wind tunnel is examined. The test section is 2.500 m x 2.500 m and 7.620 m long with a slotted wall configuration. There are six slots each in the top and bottom walls and two slots per sidewall. To maintain good flow quality and aerodynamic efficiency over the wide range of test capabilities the test section geometry is variable. The position of the test section and bottom walls, the reentry flaps at the rear of the test section slots, and the step height for reentering slot flow are remotely controlled. The test gas may be dry air or nitrogen, which for the elevated temperature (340 K) mode of operation the test medium is normally air, and heat removal is by a water cooled heat exchanger (cooling coil) located at the upstream end of the settling chamber. For the cryogenic mode of operation, heat removal is by evaporation of liquid nitrogen, which is sprayed into the circuit upstream of the fan. By utilizing liquid nitrogen as a coolant, the tunnel test temperature range is variable from 340 to 78 K. When nitrogen is injected into the circuit, venting must occur to maintain a constant pressure. Thermal insulation is installed internal to the pressure shell to minimize energy consumption.

Fuller, D. E.↗

Performance Evaluation Tools for Next Generation Scalable Computing Platforms

The Federal High Performance and Communications (HPCC) Program continue to focus on R&D in a wide range of high performance computing and communications technologies. Using its accomplishments in the past four years as building blocks towards a Global Information Infrastructure (GII), an Implementation Plan that identifies six Strategic Focus Areas for R&D has been proposed. This white paper argues that a new generation of system software and programming tools must be developed to support these focus areas, so that the R&D we invest today can lead to technology pay-off a decade from now. The Global Computing Infrastructure (GCI) in the Year 2000 and Beyond would consists of thousands of powerful computing nodes connected via high-speed networks across the globe. Users will be able to obtain computing in formation services the GCI with the ease of using a plugging a toaster into the electrical outlet on the wall anywhere in the country. Developing and managing the GO requires performance prediction and monitoring capabilities that do not exist. Various accomplishments in this field today must be integrated and expanded to support this vision.

Yan, Jerry C.↗

The Integrated Air Transportation System Evaluation Tool

Throughout U.S. history, our nation has generally enjoyed exceptional economic growth, driven in part by transportation advancements. Looking forward 25 years, when the national highway and skyway systems are saturated, the nation faces new challenges in creating transportation-driven economic growth and wealth. To meet the national requirement for an improved air traffic management system, NASA developed the goal of tripling throughput over the next 20 years, in all weather conditions while maintaining safety. Analysis of the throughput goal has primarily focused on major airline operations, primarily through the hub and spoke system.However, many suggested concepts to increase throughput may operate outside the hub and spoke system. Examples of such concepts include the Small Aircraft Transportation System, civil tiltrotor, and improved rotorcraft. Proper assessment of the potential contribution of these technologies to the domestic air transportation system requires a modeling capability that includes the country's numerous smaller airports, acting as a fundamental component of the National Air space System, and the demand for such concepts and technologies. Under this task for NASA, the Logistics Management Institute developed higher fidelity demand models that capture the interdependence of short-haul air travel with other transportation modes and explicitly consider the costs of commercial air and other transport modes. To accomplish this work, we generated forecasts of the distribution of general aviation based aircraft and GA itinerant operations at each of nearly 3.000 airport based on changes in economic conditions and demographic trends. We also built modules that estimate the demand for travel by different modes, particularly auto, commercial air, and GA. We examined GA demand from two perspectives: top-down and bottom-up, described in detail.

Wingrove, Earl R., III↗

Decision Support Tool Evaluation Report for Coral Reef Early Warning System (CREWS) Version 7.0

The Coral Reef Early Warning System (CREWS) is operated by NOAA's Office of Oceanic and Atmospheric Research as part of its Coral Reef Watch program in response to the deteriorating global state of coral reef and related benthic ecosystems. In addition to sea surface temperatures (SSTs), the two most important parameters used by the CREWS network in generating coral reef bleaching alerts are 1) wind speed and direction and 2) photosynthetically available radiation (PAR). NASA remote sensing products that can enhance CREWS in these areas include SST and PAR products from the Moderate Resolution Imaging Spectroradiometer (MODIS) and wind data from the Quick Scatterometer (QuikSCAT). CREWS researchers are also interested in chlorophyll, chromophoric dissolved organic matter (CDOM), and salinity. Chlorophyll and CDOM are directly available as NASA products, while rainfall (an available NASA product) can be used as a proxy for salinity. Other potential NASA inputs include surface reflectance products from MODIS, the Advanced Spaceborne Thermal Emission and Reflection Radiometer, and Landsat. This report also identifies NASA-supported ocean circulation models and products from future satellite missions that might enchance the CREWS DST.

D'Sa, Eurico↗

GeoLab's First Field Trials, 2010 Desert RATS: Evaluating Tools for Early Sample Characterization

As part of an accelerated prototyping project to support science operations tests for future exploration missions, we designed and built a geological laboratory, GeoLab, that was integrated into NASA's first generation Habitat Demonstration Unit-1/Pressurized Excursion Module (HDU1-PEM). GeoLab includes a pressurized glovebox for transferring and handling samples collected on geological traverses, and a suite of instruments for collecting preliminary data to help characterize those samples. The GeoLab and the HDU1-PEM were tested for the first time as part of the 2010 Desert Research and Technology Studies (DRATS), NASA's analog field exercise for testing mission technologies. The HDU1- PEM and GeoLab participated in two weeks of joint operations in northern Arizona with two crewed rovers and the DRATS science team.

Evans, Cindy A.↗

Limitations on the Use of Eye-Tracking Data to Understand Operator Awareness

Safety events in commercial aviation have implicated failures of attention and awareness, and the need for improved attention and awareness has pushed trainers toward eye-tracking systems as a primary tool for evaluating monitoring performance. Further, in the last 15 years, eye-tracking technology has become easier to acquire and use in operationally realistic settings. Although we believe that eye-tracking can be a useful evaluation tool, this paper describes basic limitations on relying on eye-tracking as the sole means for evaluating attention and awareness. A set of other measures are offered that can better identify where performance breakdowns occur.

aviation↗

Computer-Based Tools for Evaluating Graphical User Interfaces

The user interface is the component of a software system that connects two very complex system: humans and computers. Each of these two systems impose certain requirements on the final product. The user is the judge of the usability and utility of the system; the computer software and hardware are the tools with which the interface is constructed. Mistakes are sometimes made in designing and developing user interfaces because the designers and developers have limited knowledge about human performance (e.g., problem solving, decision making, planning, and reasoning). Even those trained in user interface design make mistakes because they are unable to address all of the known requirements and constraints on design. Evaluation of the user inter-face is therefore a critical phase of the user interface development process. Evaluation should not be considered the final phase of design; but it should be part of an iterative design cycle with the output of evaluation being feed back into design. The goal of this research was to develop a set of computer-based tools for objectively evaluating graphical user interfaces. The research was organized into three phases. The first phase resulted in the development of an embedded evaluation tool which evaluates the usability of a graphical user interface based on a user's performance. An expert system to assist in the design and evaluation of user interfaces based upon rules and guidelines was developed during the second phase. During the final phase of the research an automatic layout tool to be used in the initial design of graphical inter- faces was developed. The research was coordinated with NASA Marshall Space Flight Center's Mission Operations Laboratory's efforts in developing onboard payload display specifications for the Space Station.

Moore, Loretta A.↗

A human factors evaluation using tools for automated knowledge engineering

A human factors evaluation of the MH-53J helicopter cockpit is described. This evaluation was an application and futher development of Tools for Automated Knowledge Engineering (TAKE). TAKE is used to acquire and analyze knowledge from domain experts (aircrew members, system designers, maintenance personnel, human factors engineers, or others). TAKE was successfully utilized for the purpose of recommending improvements for the man-machine interfaces (MMI) in the MH-53J cockpit.

Gomes, Marie E.↗

Evaluating modeling tools for the EDOS

The Earth Observing System (EOS) Data and Operations System (EDOS) Project is developing a functional, system performance model to support the system implementation phase of the EDOS which is being designed and built by the Goddard Space Flight Center (GSFC). The EDOS Project will use modeling to meet two key objectives: (1) manage system design impacts introduced by unplanned changed in mission requirements; and (2) evaluate evolutionary technology insertions throughout the development of the EDOS. To select a suitable modeling tool, the EDOS modeling team developed an approach for evaluating modeling tools and languages by deriving evaluation criteria from both the EDOS modeling requirements and the development plan. Essential and optional features for an appropriate modeling tool were identified and compared with known capabilities of several modeling tools. Vendors were also provided the opportunity to model a representative EDOS processing function to demonstrate the applicability of their modeling tool to the EDOS modeling requirements. This paper emphasizes the importance of using a well defined approach for evaluating tools to model complex systems like the EDOS. The results of this evaluation study do not in any way signify the superiority of any one modeling tool since the results will vary with the specific modeling requirements of each project.

Knoble, Gordon↗

Composing Teams with TEAMSTaR Tool for Evaluating and Mitigating Space Team Risk

As NASA sets its sights on more Earth-independent missions, the mission to Mars as a prime example, a team’s composition becomes a critical issue for mitigating the risks of such endeavors. The purpose of this project is to develop and validate TEAMSTaR (Tool for Evaluating And Mitigating Space Team Risks), a team composition decision support system that can be used by mission stakeholders (e.g., mission schedulers, crew members) to predict how a hypothetical team’s social relationships are likely to evolve and influence crew performance over the course of a mission. TEAMSTaR will enable decision makers to evaluate composition scenarios for a set of teams, for single-member replacements, and/or for subsets of teams.

N S Contractor↗