Search NASA⌕ Search

SEARCH · Search NASA

Results for “tool evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
NASA NTRS1975

FCAP - A new tool for the evaluation of active control technology

A computer program has been developed for the evaluation of flight control systems designed for flexible aircraft. This Flight Control Analysis Program (FCAP) is designed in a modular fashion to incorporate sensor, actuator, and control logic element dynamics as well as aircraft dynamics and aerodynamics for complex configurations. Formulation of the total aircraft dynamic system is accomplished in matrix form by casting the equations in state vector format. The system stability and performance are determined in either the frequency or time domain using classical analysis techniques. The aerodynamic method used also permits evaluation of the flutter characteristics of the aircraft.

Noll, R. B.↗
NASA NTRS1978

NASA charging analyzer program: A computer tool that can evaluate electrostatic contamination

A computer code, the NASA Charging Analyzer Program (NASCAP), was developed to study the surface charging of bodies subjected to geomagnetic substorm conditions. This program will treat the material properties of a surface in a self-consistent manner and calculate the electric fields in space due to the surface charge. Trajectories of charged particles in this electric field can be computed to determine if these particles enhance surface contamination. A preliminary model of the Spacecraft Charging At The High Altitudes (SCATHA) satellite was developed in the NASCAP code and subjected to a geomagnetic substorm environment to investigate the possibility of electrostatic contamination. The results indicate that differential voltages will exist between the spacecraft ground surfaces and the insulator surfaces. The electric fields from this differential charging can enhance the contamination of spacecraft surfaces.

Stevens, N. J.↗
NASA NTRS1978

NASA Charging Analyzer Program - A computer tool that can evaluate electrostatic contamination

The data from the ATS-5 and -6 Auroral Particles Experiments have shown that the environment at geosynchronous orbit can charge spacecraft surfaces to appreciable negative values. Such surface charges could have undesirable effects on satellite equipment and the data obtained in satellite experiments. A computer program, the NASA Charging Analyzer Program (NASCAP), has, in this connection, been developed to determine the surface charging of spacecraft when encountering geomagnetic substorm conditions. Once a model of a spacecraft has been developed in the NASCAP code, the surface charging can be computed for any environmental input flux. On the basis of the obtained information regarding the surface charging, charged particle trajectories can be computed to determine if it is possible for a particle to return to a satellite surface. It is pointed out that the computer runs conducted with the NASCAP code represent the first attempts to use a self-consistent program to study the behavior of spacecraft surfaces experiencing a geomagnetic substorm condition.

Stevens, N. J.↗
NASA NTRS1993

An evaluation of software tools for the design and development of cockpit displays

The use of all-glass cockpits at the NASA Langley Research Center (LaRC) simulation facility has changed the means of design, development, and maintenance of instrument displays. The human-machine interface has evolved from a physical hardware device to a software-generated electronic display system. This has subsequently caused an increased workload at the facility. As computer processing power increases and the glass cockpit becomes predominant in facilities, software tools used in the design and development of cockpit displays are becoming both feasible and necessary for a more productive simulation environment. This paper defines LaRC requirements of a display software development tool and compares two available applications against these requirements. As a part of the software engineering process, these tools reduce development time, provide a common platform for display development, and produce exceptional real-time results.

Ellis, Thomas D., Jr.↗
NASA NTRS1995

Automatic differentiation evaluated as a tool for rotorcraft design and optimization

This paper investigates the use of automatic differentiation (AD) as a means for generating sensitivity analyses in rotorcraft design and optimization. This technique transforms an existing computer program into a new program that performs sensitivity analysis in addition to the original analysis. The original FORTRAN program calculates a set of dependent (output) variables from a set of independent (input) variables, the new FORTRAN program calculates the partial derivatives of the dependent variables with respect to the independent variables. The AD technique is a systematic implementation of the chain rule of differentiation, this method produces derivatives to machine accuracy at a cost that is comparable with that of finite-differencing methods. For this study, an analysis code that consists of the Langley-developed hover analysis HOVT, the comprehensive rotor analysis CAMRAD/JA, and associated preprocessors is processed through the AD preprocessor ADIFOR 2.0. The resulting derivatives are compared with derivatives obtained from finite-differencing techniques. The derivatives obtained with ADIFOR 2.0 are exact within machine accuracy and do not depend on the selection of step-size, as are the derivatives obtained with finite-differencing techniques.

Walsh, Joanne L.↗
NASA NTRS1994

Performance Evaluation Methodologies and Tools for Massively Parallel Programs

The need for computing power has forced a migration from serial computation on a single processor to parallel processing on multiprocessors. However, without effective means to monitor (and analyze) program execution, tuning the performance of parallel programs becomes exponentially difficult as program complexity and machine size increase. The recent introduction of performance tuning tools from various supercomputer vendors (Intel's ParAide, TMC's PRISM, CSI'S Apprentice, and Convex's CXtrace) seems to indicate the maturity of performance tool technologies and vendors'/customers' recognition of their importance. However, a few important questions remain: What kind of performance bottlenecks can these tools detect (or correct)? How time consuming is the performance tuning process? What are some important technical issues that remain to be tackled in this area? This workshop reviews the fundamental concepts involved in analyzing and improving the performance of parallel and heterogeneous message-passing programs. Several alternative strategies will be contrasted, and for each we will describe how currently available tuning tools (e.g., AIMS, ParAide, PRISM, Apprentice, CXtrace, ATExpert, Pablo, IPS-2)) can be used to facilitate the process. We will characterize the effectiveness of the tools and methodologies based on actual user experiences at NASA Ames Research Center. Finally, we will discuss their limitations and outline recent approaches taken by vendors and the research community to address them.

Yan, Jerry C.↗
NASA NTRS2005

Evaluation of a Tool for Airborne-Managed In-Trail Approach Spacing

The Advanced Terminal Area Approach Spacing (ATAAS) tool uses Automatic Dependent Surveillance-Broadcast aircraft state data to compute a speed command for an ATAAS-equipped aircraft to follow and obtain a required time interval behind another aircraft. The ATAAS tool and candidate operational procedures were tested in a high-fidelity, full mission simulator with active airline subject pilots flying an arrival scenario to obtain pilot perceptions of acceptability and workload for the concept. The aircraft consistently achieved the target spacing interval within 1 s when the ATAAS speed guidance was autothrottle-coupled and a slightly greater (4 - 5 s) but consistent interval with pilot-controlled speed changes. The subject pilots rated the ATAAS workload as similar to one with standard procedures for a nominal Instrument Landing System (ILS) approach. They also rated highly various procedural aspects (including amount of head-down time required). Eyetracker data showed only slight changes in instrument scan patterns for ATAAS versus standard ILS procedures.

Oseguera-Lohr, Rosa M.↗
NASA NTRS2011

Tools for Designing, Evaluating, and Certifying NextGen Technologies and Procedures: Automation Roles and Responsibilities

Barbara Kanki from NASA Ames Research Center will discuss research that focuses on the collaborations between pilots, air traffic controllers and dispatchers that will change in NextGen systems as automation increases and roles and responsibilities change. The approach taken by this NASA Ames team is to build a collaborative systems assessment template (CSAT) based on detailed task descriptions within each system to establish a baseline of the current operations. The collaborative content and context are delineated through the review of regulatory and advisory materials, policies, procedures and documented practices as augmented by field observations and interviews. The CSAT is developed to aid the assessment of key human factors and performance tradeoffs that result from considering different collaborative arrangements under NextGen system changes. In theory, the CSAT product may be applied to any NextGen application (such as Trajectory Based Operations) with specified ground and aircraft capabilities.

Kanki, Barbara G.↗
DOE OSTI2025

Evaluating Economic Impact: An Investment Tool for Large Language Model Integration in Workweek Management

This paper explores the development and application of an investment tool designed to quantify the costs and potential savings associated with integrating large language models (LLMs) into work week management optimization (WMO) within the nuclear industry. LLMs, with their advanced natural language processing capabilities, can significantly enhance various aspects of work management, such as problem identification, prioritization, planning, scheduling, information retrieval, and information summary. Our investment tool focuses on evaluating the return on investment (ROI) for LLM applications in WMO by considering four pivotal decision factors: model selection, application, user training, and hosting options. This paper details the development and implementation of the ROI model and illustrates its application through multiple case studies, analyzing the impact of different variables, such as work time saved, number of requests, and model performance, on the computed ROI over two years. The computed ROI is also compared over different hosting solutions. Our findings indicate that ROI increases with enhanced work time savings and optimal request load but can decline with high request volumes or increased model costs. This model aids decision-makers in the nuclear industry by providing a structured approach to assessing the economic viability and potential savings from integrating LLMs into WMO processes.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Evaluating Economic Impact: An Investment Tool for Large Language Model Integration in Workweek Management

This paper explores the development and application of an investment tool designed to quantify the costs and potential savings associated with integrating large language models (LLMs) into work week management optimization (WMO) within the nuclear industry. LLMs, with their advanced natural language processing capabilities, can significantly enhance various aspects of work management, such as problem identification, prioritization, planning, scheduling, information retrieval, and information summary. Our investment tool focuses on evaluating the return on investment (ROI) for LLM applications in WMO by considering four pivotal decision factors: model selection, application, user training, and hosting options. This paper details the development and implementation of the ROI model and illustrates its application through multiple case studies, analyzing the impact of different variables, such as work time saved, number of requests, and model performance, on the computed ROI over two years. The computed ROI is also compared over different hosting solutions. Our findings indicate that ROI increases with enhanced work time savings and optimal request load but can decline with high request volumes or increased model costs. This model aids decision-makers in the nuclear industry by providing a structured approach to assessing the economic viability and potential savings from integrating LLMs into WMO processes.

99 - GENERAL AND MISCELLANEOUS↗
NASA NTRS1992

Manned transportation system study - Evaluation of candidate transportation architectures

The overall evaluation process, the tool developed to perform the evaluation, and the evaluation results in determining the right approach to meet the nation's mannned transportation needs are presented. To address the various considerations, architecture sets consisting of the candidate transportation systems are constructed. As this methodology results in multiple architectures to examine, an architecture evaluation tool was developed to facilitate the evaluation of the architecture attribute values from the system values of the attributes.

Lance, Nicholas↗
NASA NTRS2015

Challenges of NDE Simulation Tool Challenges of NDE Simulation Tool

Realistic nondestructive evaluation (NDE) simulation tools enable inspection optimization and predictions of inspectability for new aerospace materials and designs. NDE simulation tools may someday aid in the design and certification of advanced aerospace components; potentially shortening the time from material development to implementation by industry and government. Furthermore, modeling and simulation are expected to play a significant future role in validating the capabilities and limitations of guided wave based structural health monitoring (SHM) systems. The current state-of-the-art in ultrasonic NDE/SHM simulation cannot rapidly simulate damage detection techniques for large scale, complex geometry composite components/vehicles with realistic damage types. This paper discusses some of the challenges of model development and validation for composites, such as the level of realism and scale of simulation needed for NASA' applications. Ongoing model development work is described along with examples of model validation studies. The paper will also discuss examples of the use of simulation tools at NASA to develop new damage characterization methods, and associated challenges of validating those methods.

Leckey, Cara A. C.↗
NASA NTRS1990

Simulator evaluation of the final approach spacing tool

The design and simulator evaluation of an automation tool for assisting terminal radar approach controllers in sequencing and spacing traffic onto the final approach course is described. The automation tool, referred to as the Final Approach Spacing Tool (FAST), displays speed and heading advisories for arrivals as well as sequencing information on the controller's radar display. The main functional elements of FAST are a scheduler that schedules and sequences the traffic, a 4-D trajectory synthesizer that generates the advisories, and a graphical interface that displays the information to the controller. FAST was implemented on a high performance workstation. It can be operated as a stand-alone in the Terminal Radar Approach Control (TRACON) Facility or as an element of a system integrated with automation tools in the Air Route Traffic Control Center (ARTCC). FAST was evaluated by experienced TRACON controllers in a real-time air traffic control simulation. Simulation results show that FAST significantly reduced controller workload and demonstrated a potential for an increase in landing rate.

Davis, Thomas J.↗
NASA NTRS1990

Simulator evaluation of the Final Approach Spacing Tool

The design and simulator evaluation of an automation tool for assisting terminal radar approach controllers in sequencing and spacing traffic onto the final approach course is described. The automation tool, referred to as the Final Approach Spacing Tool (FAST), displays speed and heading advisories for arrivals and sequencing information on the controller's radar display. The main functional elements of FAST are a scheduler that schedules and sequences the traffic, a four-dimensional trajectory synthesizer that generates the advisories, and a graphical interface that displays the information to the controller. FAST has been implemented on a high-performance workstation. It can be operated stand-alone in the terminal radar approach control (TRACON) facility or as an element of a system integrated with automation tools in the Air Route Traffic Control Center). Simulation results show that FAST significantly reduced controller workload and demonstrated a potential for an increase in landing rate.

Davis, Thomas J.↗
NASA NTRS1997

Fault Injection Techniques and Tools

Dependability evaluation involves the study of failures and errors. The destructive nature of a crash and long error latency make it difficult to identify the causes of failures in the operational environment. It is particularly hard to recreate a failure scenario for a large, complex system. To identify and understand potential failures, we use an experiment-based approach for studying the dependability of a system. Such an approach is applied not only during the conception and design phases, but also during the prototype and operational phases. To take an experiment-based approach, we must first understand a system's architecture, structure, and behavior. Specifically, we need to know its tolerance for faults and failures, including its built-in detection and recovery mechanisms, and we need specific instruments and tools to inject faults, create failures or errors, and monitor their effects.

Hsueh, Mei-Chen↗
NASA NTRS2005

Airborne Evaluation and Demonstration of a Time-Based Airborne Inter-Arrival Spacing Tool

An airborne tool has been developed that allows an aircraft to obtain a precise inter-arrival time-based spacing interval from the preceding aircraft. The Advanced Terminal Area Approach Spacing (ATAAS) tool uses Automatic Dependent Surveillance-Broadcast (ADS-B) data to compute speed commands for the ATAAS-equipped aircraft to obtain this inter-arrival spacing behind another aircraft. The tool was evaluated in an operational environment at the Chicago O'Hare International Airport and in the surrounding terminal area with three participating aircraft flying fixed route area navigation (RNAV) paths and vector scenarios. Both manual and autothrottle speed management were included in the scenarios to demonstrate the ability to use ATAAS with either method of speed management. The results on the overall delivery precision of the tool, based on a target spacing of 90 seconds, were a mean of 90.8 seconds with a standard deviation of 7.7 seconds. The results for the RNAV and vector cases were, respectively, M=89.3, SD=4.9 and M=91.7, SD=9.0.

Lohr, Gary W.↗