Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS1981

Methodology evaluation: Effects of independent verification and intergration on one class of application

The effects of an independent verification and integration (V and I) methodology on one class of application are described. Resource profiles are discussed. The development environment is reviewed. Seven measures are presented to test the hypothesis that V and I improve the development and product. The V and I methodology provided: (1) a decrease in requirements ambiguities and misinterpretation; (2) no decrease in design errors; (3) no decrease in the cost of correcting errors; (4) a decrease in the cost of system and acceptance testing; (5) an increase in early discovery of errors; (6) no improvement in the quality of software put into operation; and (7) a decrease in productivity and an increase in cost.

Page, J.↗
NASA NTRS2001

Nondestructive Evaluation Methodologies Developed for Certifying Composite Flywheels

Manufacturing readiness of composite rotors and certification of flywheels depend in part on the maturity of nondestructive evaluation (NDE) technology for process optimization and quality assurance, respectively. At the NASA Glenn Research Center, the capabilities and limitations of x-ray-computed tomography and radiography, as well as advanced ultrasonics were established on NDE ring and rotor standards with electrical discharge machining (EDM) notches and drilled holes. Also, intentionally seeded delamination, tow break, and insert of bagging material were introduced in hydroburst-rings to study the NDE detection capabilities of such anomalies and their effect on the damage tolerance and safe life margins of subscale rings and rotors. Examples of possible occurring flaws or anomalies in composite rings as detected by NDE and validated by destructive metallography are shown. The general NDE approach to ensure the quality of composite rotors and to help in the certification of flywheels is briefly outlined.

Baaklini, George Y.↗
NASA NTRS1995

Earth Sciences Data and Information System (ESDIS) program planning and evaluation methodology development

An Earth Sciences Data and Information System (ESDIS) Project Management Plan (PMP) is prepared. An ESDIS Project Systems Engineering Management Plan (SEMP) consistent with the developed PMP is also prepared. ESDIS and related EOS program requirements developments, management and analysis processes are evaluated. Opportunities to improve the effectiveness of these processes and program/project responsiveness to requirements are identified. Overall ESDIS cost estimation processes are evaluated, and recommendations to improve cost estimating and modeling techniques are developed. ESDIS schedules and scheduling tools are evaluated. Risk assessment, risk mitigation strategies and approaches, and use of risk information in management decision-making are addressed.

Dickinson, William B.↗
NASA NTRS2019

Evaluation Methodologies for Early Conceptual Design Using Virtual Reality and Physical Test Environments

In this study, human factor design engineers wanted to know, by using subject matter experts (SMEs), if there would be any differences in testing low-fidelity conceptual designs in a physical environment compared to a digital/virtual one. Results indicated that when testing a design concept at this early stage, a high correlation between the two environments exists, meaning SMEs found little to no difference when evaluating a design in either a physical or a digital/virtual environment. There are advantages and limitations to both environments. The virtual world gave the experts a better sense of the microgravity space environment and the relationships of space and human presence that are difficult to simulate in a 1-g physical environment. However, the interaction between human and mechanics is better enhanced in the physical world compared to the virtual world. These advantages and limitations of each environment are important; however, cost is also an important consideration when early design concepts are being used. With the cost analysis of materials, hardware, and labor conducting for this study, virtual reality showed a 68% decrease in cost over the physical mock-up build. Thus, taking all aspects of the study into consideration, at this early design life cycle phase, virtual reality shows great promise as an evaluation environment for testing early design concepts that will cost less, give more options, and increase designer’s time to design.

Harry L. Litaker Jr↗
NASA NTRS1992

Reliability evaluation methodology for NASA applications

Liquid rocket engine technology has been characterized by the development of complex systems containing large number of subsystems, components, and parts. The trend to even larger and more complex system is continuing. The liquid rocket engineers have been focusing mainly on performance driven designs to increase payload delivery of a launch vehicle for a given mission. In otherwords, although the failure of a single inexpensive part or component may cause the failure of the system, reliability in general has not been considered as one of the system parameters like cost or performance. Up till now, quantification of reliability has not been a consideration during system design and development in the liquid rocket industry. Engineers and managers have long been aware of the fact that the reliability of the system increases during development, but no serious attempts have been made to quantify reliability. As a result, a method to quantify reliability during design and development is needed. This includes application of probabilistic models which utilize both engineering analysis and test data. Classical methods require the use of operating data for reliability demonstration. In contrast, the method described in this paper is based on similarity, analysis, and testing combined with Bayesian statistical analysis.

Taneja, Vidya S.↗
NASA NTRS1994

Performance Evaluation Methodologies and Tools for Massively Parallel Programs

The need for computing power has forced a migration from serial computation on a single processor to parallel processing on multiprocessors. However, without effective means to monitor (and analyze) program execution, tuning the performance of parallel programs becomes exponentially difficult as program complexity and machine size increase. The recent introduction of performance tuning tools from various supercomputer vendors (Intel's ParAide, TMC's PRISM, CSI'S Apprentice, and Convex's CXtrace) seems to indicate the maturity of performance tool technologies and vendors'/customers' recognition of their importance. However, a few important questions remain: What kind of performance bottlenecks can these tools detect (or correct)? How time consuming is the performance tuning process? What are some important technical issues that remain to be tackled in this area? This workshop reviews the fundamental concepts involved in analyzing and improving the performance of parallel and heterogeneous message-passing programs. Several alternative strategies will be contrasted, and for each we will describe how currently available tuning tools (e.g., AIMS, ParAide, PRISM, Apprentice, CXtrace, ATExpert, Pablo, IPS-2)) can be used to facilitate the process. We will characterize the effectiveness of the tools and methodologies based on actual user experiences at NASA Ames Research Center. Finally, we will discuss their limitations and outline recent approaches taken by vendors and the research community to address them.

Yan, Jerry C.↗
NASA NTRS1990

Development and testing of methodology for evaluating the performance of multi-input/multi-output digital control systems

The development of a controller performance evaluation (CPE) methodology for multiinput/multioutput digital control systems is described. The equations used to obtain the open-loop plant, controller transfer matrices, and return-difference matrices are given. Results of applying the CPE methodology to evaluate MIMO digital flutter suppression systems being tested on an active flexible wing wind-tunnel model are presented to demonstrate the CPE capability.

Polotzky, Anthony S.↗
NASA NTRS2001

Methodology for Evaluating Raw Material Changes to RSRM Elastomeric Insulation Materials

The Reusable Solid Rocket Motor (RSRM) uses asbestos and silicon dioxide filled acrylonitrile butadiene rubber (AS-NBR) as the primary internal insulation to protect the case from heat. During the course of the RSRM Program, several changes have been made to the raw materials and processing of the AS-NBR elastomeric insulation material. These changes have been primarily caused by raw materials becoming obsolete. In addition, some process changes have been implemented that were deemed necessary to improve the quality and consistency of the AS-NBR insulation material. Each change has been evaluated using unique test efforts customized to determine the potential impacts of the specific raw material or process change. Following the evaluations, the various raw material and process changes were successfully implemented with no detectable effect on the performance of the AS-NBR insulation. This paper will discuss some of the raw material and process changes evaluated, the methodology used in designing the unique test plans, and the general evaluation results. A summary of the change history of RSRM AS-NBR internal insulation is also presented.

Mildenhall, Scott D.↗
NASA NTRS1990

Development and testing of methodology for evaluating the performance of multi-input/multi-output digital control systems

A Controller Performance Evaluation (CPE) methodology for multi-input/multi-output digital control systems was developed and tested on an aeroelastic wind-tunnel model. Modern signal processing methods were used to implement control laws and to acquire time domain data of the whole system (controller and plant) from which appropriate transfer matrices of the control system could be generated. Matrix computational procedures were used to calculate singular values of return-difference matrices at the plant input and output points to evaluate the performance of the control system. The CPE procedures effectively identified potentially destabilizing controllers and confirmed the satisfactory performance of stabilizing ones.

Pototzky, Anthony S.↗
NASA NTRS1980

Analysis of wind tunnel test results for a 9.39-per cent scale model of a VSTOL fighter/attack aircraft. Volume 2: Evaluation of prediction methodologies

An evaluation of current prediction methodologies to estimate the aerodynamic uncertainties identified for the E205 configuration is presented. This evaluation was accomplished by comparing predicted and wind tunnel test data in three major categories: untrimmed longitudinal aerodynamics; trimmed longitudinal aerodynamics; and lateral-directional aerodynamic characteristics.

Lummus, J. R.↗
NASA NTRS1984

Evaluation of the HARDMAN comparability methodology for manpower, personnel and training

The methodology evaluation and recommendation are part of an effort to improve Hardware versus Manpower (HARDMAN) methodology for projecting manpower, personnel, and training (MPT) to support new acquisition. Several different validity tests are employed to evaluate the methodology. The methodology conforms fairly well with both the MPT user needs and other accepted manpower modeling techniques. Audits of three completed HARDMAN applications reveal only a small number of potential problem areas compared to the total number of issues investigated. The reliability study results conform well with the problem areas uncovered through the audits. The results of the accuracy studies suggest that the manpower life-cycle cost component is only marginally sensitive to changes in other related cost variables. Even with some minor problems, the methodology seem sound and has good near term utility to the Army. Recommendations are provided to firm up the problem areas revealed through the evaluation.

Zimmerman, W.↗
NASA NTRS1976

The cost of energy from utility-owned solar electric systems. A required revenue methodology for ERDA/EPRI evaluations

This methodology calculates the electric energy busbar cost from a utility-owned solar electric system. This approach is applicable to both publicly- and privately-owned utilities. Busbar cost represents the minimum price per unit of energy consistent with producing system-resultant revenues equal to the sum of system-resultant costs. This equality is expressed in present value terms, where the discount rate used reflects the rate of return required on invested capital. Major input variables describe the output capabilities and capital cost of the energy system, the cash flows required for system operation amd maintenance, and the financial structure and tax environment of the utility.

Source record↗
NASA NTRS2006

Learning User Preferences for Sets of Objects

Most work on preference learning has focused on pairwise preferences or rankings over individual items. In this paper, we present a method for learning preferences over sets of items. Our learning method takes as input a collection of positive examples--that is, one or more sets that have been identified by a user as desirable. Kernel density estimation is used to estimate the value function for individual items, and the desired set diversity is estimated from the average set diversity observed in the collection. Since this is a new learning problem, we introduce a new evaluation methodology and evaluate the learning method on two data collections: synthetic blocks-world data and a new real-world music data collection that we have gathered.

preferences↗
NASA NTRS2011

A Methodology for Evaluating Artifacts Produced by a Formal Verification Process

The goal of this study is to produce a methodology for evaluating the claims and arguments employed in, and the evidence produced by formal verification activities. To illustrate the process, we conduct a full assessment of a representative case study for the Enabling Technology Development and Demonstration (ETDD) program. We assess the model checking and satisfiabilty solving techniques as applied to a suite of abstract models of fault tolerant algorithms which were selected to be deployed in Orion, namely the TTEthernet startup services specified and verified in the Symbolic Analysis Laboratory (SAL) by TTTech. To this end, we introduce the Modeling and Verification Evaluation Score (MVES), a metric that is intended to estimate the amount of trust that can be placed on the evidence that is obtained. The results of the evaluation process and the MVES can then be used by non-experts and evaluators in assessing the credibility of the verification results.

Siminiceanu, Radu I.↗
NASA NTRSDate not supplied

A New Test Methodology for Evaluating Fire Risk Due to Electrical Faults in Oxygen-Enriched Environments

This paper discusses a new test methodology for assessing the safe use of materials found in spacecraft that may be exposed to electrical faults, as performed at the NASA White Sands Test Facility. “Wire-break” testing, modeled after the Cleveland Open Cup method, identifies the conditions under which pyrolyzed material transitions from a brief flash to a propagating flame. The approach focuses on fuel mass liberated through pyrolysis, mixed with oxygen, and ignited by a piloted ignition (spark due to fusion of wire) to achieve flame propagation with the least energy. The test approach attempts to find energy density thresholds derived using I²t values from current-induced heating of various test materials and wire characteristics. The application of the data provides a useful approach to mitigating fire risks in space systems by correlating threshold data to real-world designs and scaling factors, including oxygen pressure, wire diameter, heat sinking, and contained smoke volume. Several case studies, including Apollo missions and hypothetical scenarios, illustrate practical applications of these thresholds to enhance fire safety design considerations in space environments.

methodology↗