Search NASA⌕ Search

SEARCH · Search NASA

Results for “tool evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Development of a Terrain Mapping/Crater Evolution Measurement using Diffractive Optical Elements

When landing on the moon, understanding the interaction of the engine exhaust plume with the lunar surface is critical for the success of the descent and landing flight phases. Two evaluation tools currently used are computational simulations and ground test measurements. Computational simulations require experimental measurements for comparison/validation, but ground test measurements cannot accurately emulate all aspects of an actual lunar landing; flight tests remain the only method of obtaining fully representative data. A terrain mapping/crater evolution measurement system was developed for potential inclusion on a future lander mission. This system uses two stereo cameras viewing a laser dot grid pattern projected on the ground, where the grid is created by shining a laser through one or two diffractive optical elements. CAD simulations of the stereo imaging system are first used to validate the proposed design. Laboratory testing of the system using both a large-scale fixed-geometry crater and a small-scale evolving-geometry crater validate the use of the system for terrain mapping measurements, and for its potential inclusion on a future lander mission.

Joshua M Weisberger↗
NASA NTRS2021

NASA’s Surface Deformation and Change Mission Study

The National Academies of Science, Engineering and Medicine 2017 Decadal Survey of Earth Science and Applications identified geodetic measurements of surface deformation and related change as one of the top five “observables” to be prioritized in NASA’s future program. In response, NASA commissioned a multi-center Surface Deformation and Change(SDC) team to perform a five year study of mission architectures that would support SDC observables and provide the most value to the diverse science and applications communities it serves. The study is being conducted in phases, in which the science and applications capabilities identified in the Decadal Survey are refined, candidate architectures and associated technologies to support these needs are identified, architectures are assessed against a science value framework specific to SDC, and recommendations to NASA are made. Ultimately, NASA will decide which amongst these recommendations will proceed to mission formulation. As synthetic aperture radar (SAR) was identified as the prime sensor technology to satisfy SDC observational needs, a key component of the SDC study is to assess the current state of the art in SAR sensor and supporting technology. The number of SAR systems, both civil and commercial, is growing rapidly, requiring that mission architectures not only consider technology, but availability of data from other missions, possible partnerships or collaborations, and even data purchase. The mechanism for assessment involves development of an end-to-end science performance evaluation tool for multi-satellite con-stellations, which feeds into a science value framework that con-siders science performance, technological programmatic risks, and cost. This paper will present an overview of the ongoing study including the candidate architectures and the technology road map needed to achieve the objectives of the mission.

Stephen Horst↗
NASA NTRS2021

NASA's Surface Deformation and Change Mission Study

The National Academies of Science, Engineering and Medicine 2017 Decadal Survey of Earth Science and Applications identified geodetic measurements of surface deformation and related change as one of the top five "observables" to be prioritized in NASA's program going forward. In response, NASA commissioned a multi-center Surface Deformation and Change (SDC) team to perform a five year study of mission architectures that would support SDC observables and provide the most value to the diverse science and applications communities it serves. The study is being conducted in phases, in which the science and applications capabilities identified in the Decadal Survey are interpreted and refined, candidate mission architectures and associated technologies to support these needs are identified, architectures are assessed against a science value framework specific to SDC, and recommendations to NASA are made. Ultimately, NASA will decide which amongst these recommendations will proceed to mission formulation. As synthetic aperture radar (SAR) was identified as the prime sensor technology to satisfy SDC observational needs, a key component of the SDC study is to assess the current state of the art in SAR sensor and spacecraft systems and components. The number of SAR systems, both civil and commercial, is growing rapidly, requiring that mission architectures not only consider technology, but availability of data from other missions, possible partnerships or collaborations, and even data purchase. The mechanism for assessment involves development of an end-to-end science performance evaluation tool for multi-satellite constellations, which feeds into a science value framework that considers science performance, technological programmatic risks, and cost. This paper will present an overview of the ongoing study including the architectures under consideration and the technology road map needed to achieve the objectives of the mission.

Rosen, Paul↗
NASA NTRSDate not supplied

Development of a Terrain Mapping/Crater Evolution Measurement using Diffractive Optical Elements

When landing on the moon, understanding the interaction of the engine exhaust plume with the lunar surface is critical for the success of the descent and landing flight phases. Two evaluation tools currently used are computational simulations and ground test measurements. Computational simulations require experimental measurements for comparison/validation, but ground test measurements cannot accurately emulate all aspects of an actual lunar landing; flight tests remain the only method of obtaining fully representative data. A terrain mapping/crater evolution measurement system was developed for potential inclusion on a future lander mission. This system uses two stereo cameras viewing a laser dot grid pattern projected on the ground, where the grid is created by shining a laser through one or two diffractive optical elements. CAD simulations of the stereo imaging system are first used to validate the proposed design. Laboratory testing of the system using both a large-scale fixed-geometry crater and a small-scale evolving-geometry crater validate the use of the system for terrain mapping measurements. High-speed, front-illumination shadow particle tracking of particles ejected from the evolving geometry crater is also performed, demonstrating another diagnostic that can be used to further the understanding of plume-surface interactions.

Joshua M Weisberger↗
NASA NTRSDate not supplied

Lunar Development & Test Facility, JSC B351

In anticipation of extended operations on the lunar sur-face, JSC Building B351 has been prepared to meet test needs to mature technologies that extract resources from lunar regolith, handle lunar regolith or must perform in a dusty lunar environment. Domains such as In-Situ Re-source Utilization (ISRU), dust mitigation, power generation and distribution, robotics and surface tools will all require testing with lunar regolith/simulants to demonstrate flight readiness. The Lunar Development and Test Facility (LDTF) houses environmental test capabilities, including lunar simulants, geared toward advancing Technical Readiness Level (TRL) of these lunar surface technologies. Seen as an agency need to enable and demonstrate new technologies, a portion of the facility capability was developed under the “Dirty Lunar Surface Simulation “project in FY2020, funded by the NASA Game Changing Development program. Some current uses include testing of an oxygen extraction from lunar regolith test, a spacesuit cleaning tool evaluation, and a study to measure dust effects on space radiators (thermal management).

Michael Reddington↗
NASA NTRS2024

Computational Techniques to Generate Space Launch System Aerodynamic Databases

This document describes the reasoning and trade studies used to evaluate tools for constructing the aerodynamic lineload databases for the liftoff and transition phases of flight for the Space Launch System. Three computational fluid dynamics codes (USM3D, FUN3D, Kestrel) were investigated with various turbulence models, as well as detached eddy simulation variants for the launch vehicle in free air and in proximity to the tower. Decisions were made mostly based on results from brief developmental studies performed in response to specific, unforeseen challenges that were encountered in the analysis of a given configuration. The need to develop databases in a timely manner, as well as accurately capture the expected leeward-wake flowfield characteristics, led to the selection of the Kestrel flow solver with its delayed detached eddy simulation method, the Spalart-Allmaras turbulence model, and the adaptive mesh refinement capability in the off-body Cartesian grid region.

Karen A. Deere↗
NASA NTRS1991

Standards for evaluating expert system tools

A brief survey of the literature and proposal for a standard methodology for evaluating expert system building tools are discribed. Criteria for expert systems environmental factors and expert systems tool features are also discussed.

Beach, Sharon S.↗
NASA NTRS1986

Evaluation of reliability modeling tools for advanced fault tolerant systems

The Computer Aided Reliability Estimation (CARE III) and Automated Reliability Interactice Estimation System (ARIES 82) reliability tools for application to advanced fault tolerance aerospace systems were evaluated. To determine reliability modeling requirements, the evaluation focused on the Draper Laboratories' Advanced Information Processing System (AIPS) architecture as an example architecture for fault tolerance aerospace systems. Advantages and limitations were identified for each reliability evaluation tool. The CARE III program was designed primarily for analyzing ultrareliable flight control systems. The ARIES 82 program's primary use was to support university research and teaching. Both CARE III and ARIES 82 were not suited for determining the reliability of complex nodal networks of the type used to interconnect processing sites in the AIPS architecture. It was concluded that ARIES was not suitable for modeling advanced fault tolerant systems. It was further concluded that subject to some limitations (the difficulty in modeling systems with unpowered spare modules, systems where equipment maintenance must be considered, systems where failure depends on the sequence in which faults occurred, and systems where multiple faults greater than a double near coincident faults must be considered), CARE III is best suited for evaluating the reliability of advanced tolerant systems for air transport.

Baker, Robert↗
NASA NTRS2006

Development of Experimental and Computational Aeroacoustic Tools for Advanced Liner Evaluation

Acoustic liners in aircraft engine nacelles suppress radiated noise. Therefore, as air travel increases, increasingly sophisticated tools are needed to maximize noise suppression. During the last 30 years, NASA has invested significant effort in development of experimental and computational acoustic liner evaluation tools. The Curved Duct Test Rig is a 152-mm by 381- mm curved duct that supports liner evaluation at Mach numbers up to 0.3 and source SPLs up to 140 dB, in the presence of user-selected modes. The Grazing Flow Impedance Tube is a 51- mm by 63-mm duct currently being fabricated to operate at Mach numbers up to 0.6 with source SPLs up to at least 140 dB, and will replace the existing 51-mm by 51-mm duct. Together, these test rigs allow evaluation of advanced acoustic liners over a range of conditions representative of those observed in aircraft engine nacelles. Data acquired with these test ducts are processed using three aeroacoustic propagation codes. Two are based on finite element solutions to convected Helmholtz and linearized Euler equations. The third is based on a parabolic approximation to the convected Helmholtz equation. The current status of these computational tools and their associated usage with the Langley test rigs is provided.

Jones, Michael G.↗
NASA NTRS2000

Development of a Methodology to Conduct Usability Evaluation for Hand Tools that May Reduce the Amount of Small Parts that are Dropped During Installation while Processing Space Flight Hardware

Foreign object debris (FOD) is an important concern while processing space flight hardware. FOD can be defined as "The debris that is left in or around flight hardware, where it could cause damage to that flight hardware," (United Space Alliance, 2000). Just one small screw left unintentionally in the wrong place could delay a launch schedule while it is retrieved, increase the cost of processing, or cause a potentially fatal accident. At this time, there is not a single solution to help reduce the number of dropped parts such as screws, bolts, nuts, and washers during installation. Most of the effort is currently focused on training employees and on capturing the parts once they are dropped. Advances in ergonomics and hand tool design suggest that a solution may be possible, in the form of specialty hand tools, which secure the small parts while they are being handled. To assist in the development of these new advances, a test methodology was developed to conduct a usability evaluation of hand tools, while performing tasks with risk of creating FOD. The methodology also includes hardware in the form of a testing board and the small parts that can be installed onto the board during a test. The usability of new hand tools was determined based on efficiency and the number of dropped parts. To validate the methodology, participants were tested while performing a task that is representative of the type of work that may be done when processing space flight hardware. Test participants installed small parts using their hands and two commercially available tools. The participants were from three groups: (1) students, (2) engineers / managers and (3) technicians. The test was conducted to evaluate the differences in performance when using the three installation methods, as well as the difference in performance of the three participant groups.

Miller, Darcy↗
NASA NTRS1987

The nature and evaluation of commercial expert system building tools, revision 1

This memorandum reviews the factors that constitute an Expert System Building Tool (ESBT) and evaluates current tools in terms of these factors. Evaluation of these tools is based on their structure and their alternative forms of knowledge representation, inference mechanisms and developer end-user interfaces. Next, functional capabilities, such as diagnosis and design, are related to alternative forms of mechanization. The characteristics and capabilities of existing commercial tools are then reviewed in terms of these criteria.

Gevarter, William B.↗
NASA NTRS1987

The nature and evaluation of commercial expert system building tools

This memorandum reviews the factors that constitute an Expert System Building Tool (ESBT) and evaluates current tools in terms of these factors. Evaluation of these tools is based on their structure and their alternative forms of knowledge representation, inference mechanisms and developer/end-user interfaces. Next, functional capabilities, such as diagnosis and design, are related to alternative forms of mechanization. The characteristics and capabilities of existing commercial tools are then reviewed in terms of these criteria.

Gevarter, William B.↗
NASA NTRS1998

Human Factors Assessment: The Passive Final Approach Spacing Tool (pFAST) Operational Evaluation

Automation to assist air traffic controllers in the current terminal and en route air traff ic environments is being developed at Ames Research Center in conjunction with the Federal Aviation Administration. This automation, known collectively as the Center-TRACON Automation System (CTAS), provides decision- making assistance to air traffic controllers through computer-generated advisories. One of the CTAS tools developed specifically to assist terminal area air traffic controllers is the Passive Final Approach Spacing Tool (pFAST). An operational evaluation of PFAST was conducted at the Dallas/Ft. Worth, Texas, Terminal Radar Approach Control (TRACON) facility. Human factors data collected during the test describe the impact of the automation upon the air traffic controller in terms of perceived workload and acceptance. Results showed that controller self-reported workload was not significantly increased or reduced by the PFAST automation; rather, controllers reported that the levels of workload remained primarily the same. Controller coordination and communication data were analyzed, and significant differences in the nature of controller coordination were found. Controller acceptance ratings indicated that PFAST was acceptable. This report describes the human factors data and results from the 1996 Operational Field Evaluation of Passive FAST.

Lee, Katharine K.↗
NASA NTRS2014

Satellite Sounder Data Assimilation for Improving Alaska Region Weather Forecast

A case study and monthly statistical analysis using sounder data assimilation to improve the Alaska regional weather forecast model are presented. Weather forecast in Alaska faces challenges as well as opportunities. Alaska has a large land with multiple types of topography and coastal area. Weather forecast models must be finely tuned in order to accurately predict weather in Alaska. Being in the high-latitudes provides Alaska greater coverage of polar orbiting satellites for integration into forecasting models than the lower 48. Forecasting marine low stratus clouds is critical to the Alaska aviation and oil industry and is the current focus of the case study. NASA AIRS/CrIS sounder profiles data are used to do data assimilation for the Alaska regional weather forecast model to improve Arctic marine stratus clouds forecast. Choosing physical options for the WRF model is discussed. Preprocess of AIRS/CrIS sounder data for data assimilation is described. Local observation data, satellite data, and global data assimilation data are used to verify and/or evaluate the forecast results by the MET tools Model Evaluation Tools (MET).

Zhu, Jiang↗
NASA NTRS2009

Handling Qualities Evaluation of Pilot Tools for Spacecraft Docking in Earth Orbit

A new generation of spacecraft is now under development by NASA to replace the Space Shuttle and return astronauts to the Moon. These spacecraft will have a manual control capability for several mission tasks, and the ease and precision with which pilots can execute these tasks will have an important effect on mission risk and training costs. This paper focuses on the handling qualities of a spacecraft based on dynamics similar to that of the Crew Exploration Vehicle, during the last segment of the docking task with a space station in low Earth orbit. A previous study established that handling qualities for this task degrade significantly as the level of translation-into-rotation coupling increases. The goal of this study is to evaluate the efficacy of various pilot aids designed to mitigate the handling qualities degradation caused by this coupling. Four pilot tools were ev adluaetead:d-band box/indicator, flight-path marker, translation guidance cues, and feed-forward control. Each of these pilot tools improved handling qualities, generally with greater improvements resulting from using these tools in combination. A key result of this study is that feedforward control effectively counteracts coupling effects, providing solid Level 1 handling qualities for the spacecraft configuration evaluated.

Bilimoria, Karl D.↗
NASA NTRS2010

The Mission Assessment Post Processor (MAPP): A New Tool for Performance Evaluation of Human Lunar Missions

The National Aeronautics and Space Administration s (NASA) Constellation Program paves the way for a series of lunar missions leading to a sustained human presence on the Moon. The proposed mission design includes an Earth Departure Stage (EDS), a Crew Exploration Vehicle (Orion) and a lunar lander (Altair) which support the transfer to and from the lunar surface. This report addresses the design, development and implementation of a new mission scan tool called the Mission Assessment Post Processor (MAPP) and its use to provide insight into the integrated (i.e., EDS, Orion, and Altair based) mission cost as a function of various mission parameters and constraints. The Constellation architecture calls for semiannual launches to the Moon and will support a number of missions, beginning with 7-day sortie missions, culminating in a lunar outpost at a specified location. The operational lifetime of the Constellation Program can cover a period of decades over which the Earth-Moon geometry (particularly, the lunar inclination) will go through a complete cycle (i.e., the lunar nodal cycle lasting 18.6 years). This geometry variation, along with other parameters such as flight time, landing site location, and mission related constraints, affect the outbound (Earth to Moon) and inbound (Moon to Earth) translational performance cost. The mission designer must determine the ability of the vehicles to perform lunar missions as a function of this complex set of interdependent parameters. Trade-offs among these parameters provide essential insights for properly assessing the ability of a mission architecture to meet desired goals and objectives. These trades also aid in determining the overall usable propellant required for supporting nominal and off-nominal missions over the entire operational lifetime of the program, thus they support vehicle sizing.

Williams, Jacob↗
NASA NTRS1989

Commercial Expert-System-Building Software Tools

Report evaluates commercially-available expert-system-building tools in terms of structures, representations of knowledge, inference mechanisms, interfaces with developers and end users, and capabilities of performing such functions as diagnosis and design. Software tools commercialized derivatives of artificial-intelligence systems developed by researchers at universities and research organizations. Reducing time to develop expert system by order of magnitude compared to that required with such traditional artificial development languages as LISP. Table lists 20 such tools, rating attributes as strong, fair, programmable by user, or having no capability in various criteria.

Gevarter, William B.↗