Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Development and testing of controller performance evaluation methodology for multi-input/multi-output digital control systems

Described here is the development and implementation of on-line, near real time controller performance evaluation (CPE) methods capability. Briefly discussed are the structure of data flow, the signal processing methods used to process the data, and the software developed to generate the transfer functions. This methodology is generic in nature and can be used in any type of multi-input/multi-output (MIMO) digital controller application, including digital flight control systems, digitally controlled spacecraft structures, and actively controlled wind tunnel models. Results of applying the CPE methodology to evaluate (in near real time) MIMO digital flutter suppression systems being tested on the Rockwell Active Flexible Wing (AFW) wind tunnel model are presented to demonstrate the CPE capability.

Pototzky, Anthony↗

Safety evaluation methodology for advanced coal extraction systems

Qualitative and quantitative evaluation methods for coal extraction systems were developed. The analysis examines the soundness of the design, whether or not the major hazards have been eliminated or reduced, and how the reduction would be accomplished. The quantitative methodology establishes the approximate impact of hazards on injury levels. The results are weighted by peculiar geological elements, specialized safety training, peculiar mine environmental aspects, and reductions in labor force. The outcome is compared with injury level requirements based on similar, safer industries to get a measure of the new system's success in reducing injuries. This approach provides a more detailed and comprehensive analysis of hazards and their effects than existing safety analyses.

Zimmerman, W. F.↗

Interrelationship of Nondestructive Evaluation Methodologies Applied to Testing of Composite Overwrapped Pressure Vessels

Composite Overwrapped Pressure Vessels (COPVs) are commonly used in spacecraft for containment of pressurized gases and fluids, incorporating strength and weight savings. The energy stored is capable of extensive spacecraft damage and personal injury in the event of sudden failure. These apparently simple structures, composed of a metallic media impermeable liner and fiber/resin composite overwrap are really complex structures with numerous material and structural phenomena interacting during pressurized use which requires multiple, interrelated monitoring methodologies to monitor and understand subtle changes critical to safe use. Testing of COPVs at NASA Johnson Space Center White Sands T est Facility (WSTF) has employed multiple in-situ, real-time nondestructive evaluation (NDE) methodologies as well as pre- and post-test comparative techniques to monitor changes in material and structural parameters during advanced pressurized testing. The use of NDE methodologies and their relationship to monitoring changes is discussed based on testing of real-world spacecraft COPVs. Lessons learned are used to present recommendations for use in testing, as well as a discussion of potential applications to vessel health monitoring in future applications.

Leifeste, Mark R.↗

An Overview of Argonne’s Advanced Mobility Technology Laboratory Vehicle Systems Instrumentation and Evaluation Methodology

This report will provide a general overview of the testing facilities, research equipment, and general testing methodologies Argonne utilizes to conduct vehicle technology evaluations of advanced technology research vehicles. Data is captured from vehicle evaluations that provide powertrain operation and corresponding energy consumption based on a combination of in-depth instrumentation and focused testing. This resulting dataset of hundreds of time-resolved vehicle signals provide a basis for direct analysis and model validation of vehicle specific technologies. Argonne has attempted to standardize the approach to vehicle instrumentation and testing at Argonne, but it should be noted that each vehicle, and the corresponding assessment, remains unique. It is suggested that the reader reference vehicle specific testing reports for an overview of the unique aspects for each test vehicle. Additionally, the datasets for research vehicles are made publicly available through the Advanced Mobility Technology Laboratory’s Downloadable Driving Database (D3) at www.anl.gov/d3.

33 ADVANCED PROPULSION SYSTEMS↗

Transportation systems evaluation methodology development and applications, phase 3

Transportation systems or proposed changes in current systems are evaluated. Four principal evaluation criteria are incorporated in the process, operating performance characteristics as viewed by potential users, decisions based on the perceived impacts of the system, estimating what is required to reduce the system to practice; and predicting the ability of the concept to attract financial support. A series of matrix multiplications in which the various matrices represent evaluations in a logical sequence of the various discrete steps in a management decision process is used. One or more alternatives are compared with the current situation, and the result provides a numerical rating which determines the desirability of each alternative relative to the norm and to each other. The steps in the decision process are isolated so that contributions of each to the final result are readily analyzed. The ability to protect against bias on the part of the evaluators, and the fact that system parameters which are basically qualitative in nature can be easily included are advantageous.

Kuhlthau, A. R.↗

Methodology evaluation: Effects of independent verification and intergration on one class of application

The effects of an independent verification and integration (V and I) methodology on one class of application are described. Resource profiles are discussed. The development environment is reviewed. Seven measures are presented to test the hypothesis that V and I improve the development and product. The V and I methodology provided: (1) a decrease in requirements ambiguities and misinterpretation; (2) no decrease in design errors; (3) no decrease in the cost of correcting errors; (4) a decrease in the cost of system and acceptance testing; (5) an increase in early discovery of errors; (6) no improvement in the quality of software put into operation; and (7) a decrease in productivity and an increase in cost.

Page, J.↗

Nondestructive Evaluation Methodologies Developed for Certifying Composite Flywheels

Manufacturing readiness of composite rotors and certification of flywheels depend in part on the maturity of nondestructive evaluation (NDE) technology for process optimization and quality assurance, respectively. At the NASA Glenn Research Center, the capabilities and limitations of x-ray-computed tomography and radiography, as well as advanced ultrasonics were established on NDE ring and rotor standards with electrical discharge machining (EDM) notches and drilled holes. Also, intentionally seeded delamination, tow break, and insert of bagging material were introduced in hydroburst-rings to study the NDE detection capabilities of such anomalies and their effect on the damage tolerance and safe life margins of subscale rings and rotors. Examples of possible occurring flaws or anomalies in composite rings as detected by NDE and validated by destructive metallography are shown. The general NDE approach to ensure the quality of composite rotors and to help in the certification of flywheels is briefly outlined.

Baaklini, George Y.↗

Earth Sciences Data and Information System (ESDIS) program planning and evaluation methodology development

An Earth Sciences Data and Information System (ESDIS) Project Management Plan (PMP) is prepared. An ESDIS Project Systems Engineering Management Plan (SEMP) consistent with the developed PMP is also prepared. ESDIS and related EOS program requirements developments, management and analysis processes are evaluated. Opportunities to improve the effectiveness of these processes and program/project responsiveness to requirements are identified. Overall ESDIS cost estimation processes are evaluated, and recommendations to improve cost estimating and modeling techniques are developed. ESDIS schedules and scheduling tools are evaluated. Risk assessment, risk mitigation strategies and approaches, and use of risk information in management decision-making are addressed.

Dickinson, William B.↗

Evaluation Methodologies for Early Conceptual Design Using Virtual Reality and Physical Test Environments

In this study, human factor design engineers wanted to know, by using subject matter experts (SMEs), if there would be any differences in testing low-fidelity conceptual designs in a physical environment compared to a digital/virtual one. Results indicated that when testing a design concept at this early stage, a high correlation between the two environments exists, meaning SMEs found little to no difference when evaluating a design in either a physical or a digital/virtual environment. There are advantages and limitations to both environments. The virtual world gave the experts a better sense of the microgravity space environment and the relationships of space and human presence that are difficult to simulate in a 1-g physical environment. However, the interaction between human and mechanics is better enhanced in the physical world compared to the virtual world. These advantages and limitations of each environment are important; however, cost is also an important consideration when early design concepts are being used. With the cost analysis of materials, hardware, and labor conducting for this study, virtual reality showed a 68% decrease in cost over the physical mock-up build. Thus, taking all aspects of the study into consideration, at this early design life cycle phase, virtual reality shows great promise as an evaluation environment for testing early design concepts that will cost less, give more options, and increase designer’s time to design.

Harry L. Litaker Jr↗

Glauber’s Salt Composites for HVAC Applications: A Study on the Use of the T-History Method with a Modified Data Evaluation Methodology

Phase change materials (PCMs) can be utilized in buildings for peak load shifting in air conditioning systems, and the use of salt hydrate-based PCMs can reduce the cost of thermal energy storage devices. Glauber’s salt is an economical salt hydrate PCM with a melting point of around 32 °C. However, the desired melting range typically falls between 18 and 22 °C for building air conditioning applications. Although many researchers have characterized Glauber’s salt and its composites with modified melting points, enthalpy–temperature curves for composites of Glauber’s salt and NaCl are unavailable. In this study, we report the melting and solidification enthalpy–temperature curves for two different composites of Glauber’s salt and NaCl with a melting point of 21 °C obtained by the T-history method. Both composites contain NaCl to suppress the melting point, borax to reduce supercooling, and sodium polyacrylate as a thickener to enhance cyclic stability. The first composite with 12 wt.% NaCl demonstrated 139 kJ·kg−1 of latent heat of fusion, and the second composite with 9 wt.% NaCl demonstrated 171 kJ·kg−1. Both the composites have high volumetric energy densities compared to their organic counterparts with similar melting points.

Chemistry↗

Reliability evaluation methodology for NASA applications

Liquid rocket engine technology has been characterized by the development of complex systems containing large number of subsystems, components, and parts. The trend to even larger and more complex system is continuing. The liquid rocket engineers have been focusing mainly on performance driven designs to increase payload delivery of a launch vehicle for a given mission. In otherwords, although the failure of a single inexpensive part or component may cause the failure of the system, reliability in general has not been considered as one of the system parameters like cost or performance. Up till now, quantification of reliability has not been a consideration during system design and development in the liquid rocket industry. Engineers and managers have long been aware of the fact that the reliability of the system increases during development, but no serious attempts have been made to quantify reliability. As a result, a method to quantify reliability during design and development is needed. This includes application of probabilistic models which utilize both engineering analysis and test data. Classical methods require the use of operating data for reliability demonstration. In contrast, the method described in this paper is based on similarity, analysis, and testing combined with Bayesian statistical analysis.

Taneja, Vidya S.↗

Performance Evaluation Methodologies and Tools for Massively Parallel Programs

The need for computing power has forced a migration from serial computation on a single processor to parallel processing on multiprocessors. However, without effective means to monitor (and analyze) program execution, tuning the performance of parallel programs becomes exponentially difficult as program complexity and machine size increase. The recent introduction of performance tuning tools from various supercomputer vendors (Intel's ParAide, TMC's PRISM, CSI'S Apprentice, and Convex's CXtrace) seems to indicate the maturity of performance tool technologies and vendors'/customers' recognition of their importance. However, a few important questions remain: What kind of performance bottlenecks can these tools detect (or correct)? How time consuming is the performance tuning process? What are some important technical issues that remain to be tackled in this area? This workshop reviews the fundamental concepts involved in analyzing and improving the performance of parallel and heterogeneous message-passing programs. Several alternative strategies will be contrasted, and for each we will describe how currently available tuning tools (e.g., AIMS, ParAide, PRISM, Apprentice, CXtrace, ATExpert, Pablo, IPS-2)) can be used to facilitate the process. We will characterize the effectiveness of the tools and methodologies based on actual user experiences at NASA Ames Research Center. Finally, we will discuss their limitations and outline recent approaches taken by vendors and the research community to address them.

Yan, Jerry C.↗

Development and testing of methodology for evaluating the performance of multi-input/multi-output digital control systems

The development of a controller performance evaluation (CPE) methodology for multiinput/multioutput digital control systems is described. The equations used to obtain the open-loop plant, controller transfer matrices, and return-difference matrices are given. Results of applying the CPE methodology to evaluate MIMO digital flutter suppression systems being tested on an active flexible wing wind-tunnel model are presented to demonstrate the CPE capability.

Polotzky, Anthony S.↗

Methodology for Evaluating Raw Material Changes to RSRM Elastomeric Insulation Materials

The Reusable Solid Rocket Motor (RSRM) uses asbestos and silicon dioxide filled acrylonitrile butadiene rubber (AS-NBR) as the primary internal insulation to protect the case from heat. During the course of the RSRM Program, several changes have been made to the raw materials and processing of the AS-NBR elastomeric insulation material. These changes have been primarily caused by raw materials becoming obsolete. In addition, some process changes have been implemented that were deemed necessary to improve the quality and consistency of the AS-NBR insulation material. Each change has been evaluated using unique test efforts customized to determine the potential impacts of the specific raw material or process change. Following the evaluations, the various raw material and process changes were successfully implemented with no detectable effect on the performance of the AS-NBR insulation. This paper will discuss some of the raw material and process changes evaluated, the methodology used in designing the unique test plans, and the general evaluation results. A summary of the change history of RSRM AS-NBR internal insulation is also presented.

Mildenhall, Scott D.↗

Development and testing of methodology for evaluating the performance of multi-input/multi-output digital control systems

A Controller Performance Evaluation (CPE) methodology for multi-input/multi-output digital control systems was developed and tested on an aeroelastic wind-tunnel model. Modern signal processing methods were used to implement control laws and to acquire time domain data of the whole system (controller and plant) from which appropriate transfer matrices of the control system could be generated. Matrix computational procedures were used to calculate singular values of return-difference matrices at the plant input and output points to evaluate the performance of the control system. The CPE procedures effectively identified potentially destabilizing controllers and confirmed the satisfactory performance of stabilizing ones.

Pototzky, Anthony S.↗