Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

The case for applying an early-lifecycle technology evaluation methodology to comparative evaluation of requirements engineering research

The premise of this paper is taht there is a useful analogy between evaluation of proposed problem solutions and evaluation of requirements engineering research itself. Both of these application areas face the challenges of evaluation early in the lifecycle, of the need to consider a wide variety of factors, and of the need to combine inputs from multiple stakeholders in making thse evaluation and subsequent decisions.

technology transfer↗

A dynamic systems engineering methodology research study. Phase 2: Evaluating methodologies, tools, and techniques for applicability to NASA's systems projects

A study of NASA's Systems Management Policy (SMP) concluded that the primary methodology being used by the Mission Operations and Data Systems Directorate and its subordinate, the Networks Division, is very effective. Still some unmet needs were identified. This study involved evaluating methodologies, tools, and techniques with the potential for resolving the previously identified deficiencies. Six preselected methodologies being used by other organizations with similar development problems were studied. The study revealed a wide range of significant differences in structure. Each system had some strengths but none will satisfy all of the needs of the Networks Division. Areas for improvement of the methodology being used by the Networks Division are listed with recommendations for specific action.

Paul, Arthur S.↗

Evaluation methodology guidance for stack packages

This report provides evaluation methodology guidance based on previous National Aeronautics and Space Administration (NASA) reports and literature surveys for 3D stack packages and assemblies. Two aspects of technology are covered: the package itself (guidance for functional packages) and package assembly manufacturing and reliability. This work was funded by the NASA Electronic Parts and Packaging (NEPP) Program. The objectives of this NEPP project are to: Perform a literature survey of 3D stack technology; perform a literature survey on the evaluation methodology for 3D package and assembly; combine the two aspects to provide evaluation methodology for both aspects with consideration of interactions between package and assembly; generate guidance on the evaluation methodology for 3D stack package integrity prior to and after assembly; provide recommendations on future experimental activities. The qualification and evaluation methodology guidelines will facilitate NASA projects in effectively evaluating the reliability of very dense and newly available high-density 3D stack packages, allowing more processing power in a smaller board footprint and lower system weight.

Gerke, David↗

Coal gasification systems engineering and analysis. Appendix E: Cost estimation and economic evaluation methodology

The cost estimation and economic evaluation methodologies presented are consistent with industry practice for assessing capital investment requirements and operating costs of coal conversion systems. All values stated are based on January, 1980 dollars with appropriate recognition of the time value of money. Evaluation of project economic feasibility can be considered a two step process (subject to considerable refinement). First, the costs of the project must be quantified and second, the price at which the product can be manufacturd must be determined. These two major categories are discussed. The summary of methodology is divided into five parts: (1) systems costs, (2)instant plant costs, (3) annual operating costs, (4) escalation and discounting process, and (5) product pricing.

Source record↗

An Evaluation Methodology for Traffic Awareness Displays

An evaluation methodology for traffic awareness displays for helicopters and other vertical/short takeoff aircraft was developed. Pilots of vertical/short takeoff aircraft wil1 require more traffic information than would pilots of conventional aircraft to avoid both other vertical/short takeoff traffic and conventional traffic. The BF Goodrich Skywatch traffic advisory display was used as a candidate display to develop a procedure for evaluating the usefulness of such displays. Four high-time helicopter pilots participated in a 16-hour flight evaluation. They flew a closed circuit in the San Francisco Bay Area. In one-half of the flights the evaluation pilot had the traffic advisory display as an aid in detecting and locating traffic. In the other half of the flights the traffic advisory display was not available to the evaluation pilot. Data examined include measures of traffic advisory display performance and pilot performance in detecting traffic, as well as subjective workload and situation awareness data. The traffic advisory system did not help the pilots to detect more traffic. The importance of detection to traffic awareness is discussed.

DeMaio, Joe↗

Fuel Systems Architecture (FSA) evaluation criteria and concept evaluation methodology

Consideration is given to two methods developed for the evaluation, screening, and ranking of concepts for Space Exploration Initiative vehicle propellant management systems. The methods selected for handling this multicriteria decision problem are based on the utility theory which transforms both qualitative and quantitative criteria into a nondimensional utility scale for comparison of dissimilar figures of merit. The development of the resultant FSA evaluation criteria and concept evaluation methodology is summarized.

Hendershot, J. E.↗

Group 1: Evaluations Methodologies

m:N operations, multiple operators controlling mulitple vehicles, is a relatively new operating mode. As such, new evaluation methodologies are needed. In this presentation, neglect time and service time metrics are proposed as well as analysis candidates.

multiple↗

Evaluation methodologies for an advanced information processing system

The system concept and requirements for an Advanced Information Processing System (AIPS) are briefly described, but the emphasis of this paper is on the evaluation methodologies being developed and utilized in the AIPS program. The evaluation tasks include hardware reliability, maintainability and availability, software reliability, performance, and performability. Hardware RMA and software reliability are addressed with Markov modeling techniques. The performance analysis for AIPS is based on queueing theory. Performability is a measure of merit which combines system reliability and performance measures. The probability laws of the performance measures are obtained from the Markov reliability models. Scalar functions of this law such as the mean and variance provide measures of merit in the AIPS performability evaluations.

Schabowsky, R. S., Jr.↗

A Programming Environment Evaluation Methodology for Object-Oriented Systems

The object-oriented design strategy as both a problem decomposition and system development paradigm has made impressive inroads into the various areas of the computing sciences. Substantial development productivity improvements have been demonstrated in areas ranging from artificial intelligence to user interface design. However, there has been very little progress in the formal characterization of these productivity improvements and in the identification of the underlying cognitive mechanisms. The development and validation of models and metrics of this sort require large amounts of systematically-gathered structural and productivity data. There has, however, been a notable lack of systematically-gathered information on these development environments. A large part of this problem is attributable to the lack of a systematic programming environment evaluation methodology that is appropriate to the evaluation of object-oriented systems.

Dominick, Wayne D.↗

Safety Evaluation Methodology for Mining Systems

Methodolgy evaluates design of proposed mining systems. Analysis tests proposed mining systems against specifications and hazards of existing similar systems, examines soundness of new design in terms of reducing or eliminating major health and safety hazards, and identifies major design weaknesses.

Zimmerman, W. F.↗

A display evaluation methodology applied to vertical situation displays

An approach to display evaluation based on the optimal-control or state-variable model of the human operator is described. The approach evolved over the past several years, and is believed to have significant advantages for display evaluation. The foundations of the methodology are briefly described, and results are presented of its application to the analysis of vertical situation displays for STOL approach. This analysis includes the effects of both status and command displays on pilot workload and system performance.

Baron, S.↗

Development and testing of controller performance evaluation methodology for multi-input/multi-output digital control systems

Described here is the development and implementation of on-line, near real time controller performance evaluation (CPE) methods capability. Briefly discussed are the structure of data flow, the signal processing methods used to process the data, and the software developed to generate the transfer functions. This methodology is generic in nature and can be used in any type of multi-input/multi-output (MIMO) digital controller application, including digital flight control systems, digitally controlled spacecraft structures, and actively controlled wind tunnel models. Results of applying the CPE methodology to evaluate (in near real time) MIMO digital flutter suppression systems being tested on the Rockwell Active Flexible Wing (AFW) wind tunnel model are presented to demonstrate the CPE capability.

Pototzky, Anthony↗

Safety evaluation methodology for advanced coal extraction systems

Qualitative and quantitative evaluation methods for coal extraction systems were developed. The analysis examines the soundness of the design, whether or not the major hazards have been eliminated or reduced, and how the reduction would be accomplished. The quantitative methodology establishes the approximate impact of hazards on injury levels. The results are weighted by peculiar geological elements, specialized safety training, peculiar mine environmental aspects, and reductions in labor force. The outcome is compared with injury level requirements based on similar, safer industries to get a measure of the new system's success in reducing injuries. This approach provides a more detailed and comprehensive analysis of hazards and their effects than existing safety analyses.

Zimmerman, W. F.↗

Interrelationship of Nondestructive Evaluation Methodologies Applied to Testing of Composite Overwrapped Pressure Vessels

Composite Overwrapped Pressure Vessels (COPVs) are commonly used in spacecraft for containment of pressurized gases and fluids, incorporating strength and weight savings. The energy stored is capable of extensive spacecraft damage and personal injury in the event of sudden failure. These apparently simple structures, composed of a metallic media impermeable liner and fiber/resin composite overwrap are really complex structures with numerous material and structural phenomena interacting during pressurized use which requires multiple, interrelated monitoring methodologies to monitor and understand subtle changes critical to safe use. Testing of COPVs at NASA Johnson Space Center White Sands T est Facility (WSTF) has employed multiple in-situ, real-time nondestructive evaluation (NDE) methodologies as well as pre- and post-test comparative techniques to monitor changes in material and structural parameters during advanced pressurized testing. The use of NDE methodologies and their relationship to monitoring changes is discussed based on testing of real-world spacecraft COPVs. Lessons learned are used to present recommendations for use in testing, as well as a discussion of potential applications to vessel health monitoring in future applications.

Leifeste, Mark R.↗

Transportation systems evaluation methodology development and applications, phase 3

Transportation systems or proposed changes in current systems are evaluated. Four principal evaluation criteria are incorporated in the process, operating performance characteristics as viewed by potential users, decisions based on the perceived impacts of the system, estimating what is required to reduce the system to practice; and predicting the ability of the concept to attract financial support. A series of matrix multiplications in which the various matrices represent evaluations in a logical sequence of the various discrete steps in a management decision process is used. One or more alternatives are compared with the current situation, and the result provides a numerical rating which determines the desirability of each alternative relative to the norm and to each other. The steps in the decision process are isolated so that contributions of each to the final result are readily analyzed. The ability to protect against bias on the part of the evaluators, and the fact that system parameters which are basically qualitative in nature can be easily included are advantageous.

Kuhlthau, A. R.↗