Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation process”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

The Preparation for and Execution of Engineering Operations for the Mars Curiosity Rover Mission

The Mars Science Laboratory Curiosity Rover mission is the most complex and scientifically packed rover that has ever been operated on the surface of Mars. The preparation leading up to the surface mission involved various tests, contingency planning and integration of plans between various teams and scientists for determining how operation of the spacecraft (s/c) would be facilitated. In addition, a focused set of initial set of health checks needed to be defined and created in order to ensure successful operation of rover subsystems before embarking on a two year science journey. This paper will define the role and responsibilities of the Engineering Operations team, the process involved in preparing the team for rover surface operations, the predefined engineering activities performed during the early portion of the mission, and the evaluation process used for initial and day to day spacecraft operational assessment.

Mars↗

Evaluation of methods for rapid determination of freezing point of aviation fuels

Methods for identification of the more promising concepts for the development of a portable instrument to rapidly determine the freezing point of aviation fuels are described. The evaluation process consisted of: (1) collection of information on techniques previously used for the determination of the freezing point, (2) screening and selection of these techniques for further evaluation of their suitability in a portable unit for rapid measurement, and (3) an extensive experimental evaluation of the selected techniques and a final selection of the most promising technique. Test apparatuses employing differential thermal analysis and the change in optical transparency during phase change were evaluated and tested. A technique similar to differential thermal analysis using no reference fuel was investigated. In this method, the freezing point was obtained by digitizing the data and locating the point of inflection. Results obtained using this technique compare well with those obtained elsewhere using different techniques. A conceptual design of a portable instrument incorporating this technique is presented.

Mathiprakasam, B.↗

Evaluating Education and Science at the KSC Visitor Complex

As part of a two-year NASA-ASEE project, a preliminary evaluation and subsequent recommendations were developed to improve the education and science content of the Kennedy Space Center Visitor Complex exhibits. Recommendations for improvements in those exhibits were based on qualitative descriptions of the exhibits, on comparisons to similar exhibit collections, and on available evaluation processes. Because of the subjective nature of measuring content in a broad group of exhibits and displays, emphasis is placed on employing a survey format for a follow-on, more quantitative evaluation. The use of an external organization for this evaluation development is also recommended to reduce bias and increase validity.

Erickson, Lance K.↗

Evaluating Education and Science at the KSC Visitor Complex

As part of a two-year NASA-ASEE project, a preliminary evaluation and subsequent recommendations were developed to improve the education and science content of the Kennedy Space Center Visitor Complex exhibits. Recommendations for improvements in those exhibits were based on qualitative descriptions of the exhibits, on comparisons to similar exhibit collections, and on available evaluation processes. Because of the subjective nature of measuring content in a broad group of exhibits and displays, emphasis is placed on employing a survey format for a follow-on, more quantitative evaluation. The use of an external organization for this evaluation development is also recommended to reduce bias and increase validity.

Erickson, Lance K.↗

Formative and summative evaluation efforts for the Teacher Enhancement Institute conducted at the NASA Langley Research Center, summer 1994

The Teacher Enhancement Institute (TEI) at NASA Langley Research Center was developed in response to Executive Order 12821 which mandates national laboratories to 'assist in the mathematics and science education of our Nation's students, teachers, parents, and the public by establishing programs at their agency to provide for training elementary and secondary school teachers to improve their knowledge of mathematics and science. Such programs, to the maximum extent possible, shall involve partnerships with universities, state and local elementary and secondary school authorities, corporations and community based organizations'. The faculty worked closely with one another and the invited speakers to insure that the sessions supported the objectives. Speakers were informed of the objectives and given guidance concerning form and function for the session. Faculty members monitored sessions to assist speakers and to provide a quality control function. Faculty provided feedback to speakers concerning general objective accomplishment. Participant comments were also provided when applicable. Post TEI surveys asked for specific comments about each TEI session. During the second of the two, two week institutes, daily critiques were provided to the participants for their reflection. This seemed to provide much improved feedback to speakers and faculty because the sessions were fresh in each participant's mind. Between sessions one and two, some changes were made to the program as a result of the formative evaluation process. Those changes, though, were minor in nature and comprised what may be called 'fine tuning' a well conceived and implemented program. After the objectives were written, an assessment instrument was developed to test the accomplishment of the objectives. This instrument was actually two surveys, one given before the TEI and one given after the TEI. In using such a series, it was expected that changes in the participants induced by attendance at TEI may be discovered. Because the institute was limited in time and depth of exposure, attitudinal changes (self-assessment of ability and confidence) were chosen to be surveyed. On the pre-survey, seven general categories of questions were asked. The post-survey repeated three of these categories, providing a pre and post evaluation of the same questions and added a fourth category which asked the participant to self-assess objective accomplishment. The assessment process for TEI was valuable when one looks at the final accomplishments of the TEI. A number of aspects stand out: (1) formative evaluation during project development allowed the goals and objectives to guide the development of the institute; (2) formative evaluation provided positive guidance to presenters in developing and implementing their session; (3) formative evaluation helped presenters to improve or focus their sessions; (4) summative evaluation provided managers a way to gauge the success of the institute; (5) summative evaluation provided a benchmark for future programs to be measured against.

Carlson, Randal D.↗

Experimental and Analytical Evaluation of a Composite Honeycomb Deployable Energy Absorber

In 2006, the NASA Subsonic Rotary Wing Aeronautics Program sponsored the experimental and analytical evaluation of an externally deployable composite honeycomb structure that is designed to attenuate impact energy during helicopter crashes. The concept, which is designated the Deployable Energy Absorber (DEA), utilizes an expandable Kevlar honeycomb structure to dissipate kinetic energy through crushing. The DEA incorporates a unique flexible hinge design that allows the honeycomb to be packaged and stowed flat until needed for deployment. A variety of deployment options such as linear, radial, and/or hybrid methods can be used. Experimental evaluation of the DEA utilized a building block approach that included material characterization testing of its constituent, Kevlar -129 fabric/epoxy, and flexural testing of single hexagonal cells. In addition, the energy attenuation capabilities of the DEA were demonstrated through multi-cell component dynamic crush tests, and vertical drop tests of a composite fuselage section, retrofitted with DEA blocks, onto concrete, water, and soft soil. During each stage of the DEA evaluation process, finite element models of the test articles were developed and simulations were performed using the explicit, nonlinear transient dynamic finite element code, LS-DYNA. This report documents the results of the experimental evaluation that was conducted to assess the energy absorption capabilities of the DEA.

Jackson, Karen E.↗

Evaluation of Portable Multi-Gas Analyzers for use by Safety Personnel

During confined space entry operations as well as Shuttle-safing operations, United Space Alliance (USA)/National Aeronautics and Space Administration (NASA) safety personnel use a variety of portable instrumentation to monitor for hazardous levels of compounds such as nitrogen dioxide (N%), monomethylhydrazine (NMM), FREON 21, ammonia (NH3), oxygen (O2), and combustibles (as hydrogen (H2)). Except for O2 and H2, each compound is monitored using a single analyzer. In many cases these analyzers are 5 to 10 years old and require frequent maintenance. In addition, they are cumbersome to carry and tend to make the job of personnel monitoring physically taxing. As part of an effort to upgrade the sensor technology background information was requested from a total of 27 manufacturers of portable multi-gas instruments. A set of criteria was established to determine which vendors would be selected for laboratory evaluation. These criteria were based on requests made by USA/NASA Safety personnel in order to meet requirements within their respective areas for confined-space and Shuttle-safing operations. Each of the 27 manufacturers of multi-gas analyzers was sent a copy of the criteria and asked to fill in the appropriate information pertaining to their instrumentation. Based on the results of the sensor criteria worksheets, a total of 9 vendors out of 27 surveyed manufacturers were chosen for evaluation. Each vendor included in the final evaluation process was requested to configure each of two analyzers with NO2, NH3, O2, and combustible sensors. A set of lab tests was designed in order to determine which of the multi-gas instruments under evaluation was best suited for use in both shuttle and confined space operations. These tests included linearity/repeatability, zero/span drift response/recovery, humidity, interference, and maintenance. At the conclusion of lab testing three vendors were selected for additional field testing. Based on the results of both the lab and field evaluations a single vendor was recommended for use by NASA/IJSA Safety personnel. Vendor selection criteria, as well as the results from both laboratory and field testing of the multi-gas analyzers, are presented as part of this paper.

Lueck, D. E.↗

Process for Nondestructive Evaluation of the Quality of a Crimped Wire Connector

A process and apparatus for collecting data for nondestructive evaluation of the quality of a crimped wire connector are provided. The process involves providing a crimping tool having an anvil and opposing jaw for crimping a terminal onto a stranded wire, moving the jaw relative to the anvil to close the distance between the jaw and the anvil and thereby compress the terminal against the wire, while transmitting ultrasonic waves that are propagated through the terminal-wire combination and received at a receiving ultrasonic transducer as the jaw is moved relative to the anvil, and detecting and recording the position of the jaw relative to the anvil as a function of time and detecting and recording the amplitude of the ultrasonic wave that is received at the receiving ultrasonic transducer as a function of time as the jaw is moved relative to the anvil.

Yost, William T.↗

Mechanisms of deterioration of nutrients

The retention of flavor during freeze drying was studied with model systems. Mechanisms by which flavor retention phenomena is explained were developed and process conditions specified so that flavor retention is optimized. The literature is reviewed and results of studies of the flavor retention behavior of a number of real food products, including both liquid and solid foods are evaluated. Process parameters predicted by the mechanisms to be of greatest significance are freezing rate, initial solids content, and conditions which result in maintenance of sample structure. Flavor quality for the real food showed the same behavior relative to process conditions as predicted by the mechanisms based on model system studies.

Karel, M.↗

Biomedical technology transfer: A manufacturer's viewpoint

Transfer of technology from non-commercial institutions to industry has played an important role in the development of medical electronics. It is a difficult process, but if the ideas are sound, if clear medical benefits exist and if there is good fit with business plans and the strengths and goals of both parties are complementary, it can work well. In the evaluation process it is considered whether the device meets general tests for suitability for the company, whether there are opportunities for proprietary or patent protection, and whether the medical benefits are self evident or the acceptance period is apt to be long.

Morton, D. O.↗

A Probabilistic Software System Attribute Acceptance Paradigm for COTS Software Evaluation

Standard software requirement formats are written from top-down perspectives only, that is, from an ideal notion of a client s needs. Despite the exactness of the standard format, software and system errors in designed systems have abounded. Bad and inadequate requirements have resulted in cost overruns, schedule slips and lost profitability. Commercial off-the-shelf (COTS) software components are even more troublesome than designed systems because they are often provided as is and subsequently delivered with unsubstantiated validation of described capabilities. For COTS software, there needs to be a way to express the client s software needs in a consistent and formal manner using software system attributes derived from software quality standards. Additionally, the format needs to be amenable to software evaluation processes that integrate observable evidence garnered from historical data. This paper presents a paradigm that effectively bridges the gap between what a client desires (top-down) and what has been demonstrated (bottom-up) for COTS software evaluation. The paradigm addresses the specification of needs before the software evaluation is performed and can be used to increase the shared understanding between clients and software evaluators about what is required and what is technically possible.

Morris, A. Terry↗

Closed Loop Requirements and Analysis Management

Effective systems engineering involves the use of analysis in the derivation of requirements and verification of designs against those requirements. The initial development of requirements often depends on analysis for the technical definition of specific aspects of a product. Following the allocation of system-level requirements to a product's components, the closure of those requirements often involves analytical approaches to verify that the requirement criteria have been satisfied. Meanwhile, changes that occur in between these two processes need to be managed in order to achieve a closed-loop requirement derivation/verification process. Herein are presented concepts for employing emerging Team center capabilities to jointly manage requirements and analysis data such that analytical techniques are utilized to effectively derive and allocate requirements, analyses are consulted and updated during the change evaluation processes, and analyses are leveraged during the design verification process. Recommendations on concept validation case studies are also discussed.

Lamoreaux, Michael↗

Evaluation of Job Queuing/Scheduling Software: Phase I Report

The recent proliferation of high performance work stations and the increased reliability of parallel systems have illustrated the need for robust job management systems to support parallel applications. To address this issue, the national Aerodynamic Simulation (NAS) supercomputer facility compiled a requirements checklist for job queuing/scheduling software. Next, NAS began an evaluation of the leading job management system (JMS) software packages against the checklist. This report describes the three-phase evaluation process, and presents the results of Phase 1: Capabilities versus Requirements. We show that JMS support for running parallel applications on clusters of workstations and parallel systems is still insufficient, even in the leading JMS's. However, by ranking each JMS evaluated against the requirements, we provide data that will be useful to other sites in selecting a JMS.

Jones, James Patton↗

Smart Sensor Demonstration Payload

Sensors are a critical element to any monitoring, control, and evaluation processes such as those needed to support ground based testing for rocket engine test. Sensor applications involve tens to thousands of sensors; their reliable performance is critical to achieving overall system goals. Many figures of merit are used to describe and evaluate sensor characteristics; for example, sensitivity and linearity. In addition, sensor selection must satisfy many trade-offs among system engineering (SE) requirements to best integrate sensors into complex systems [1]. These SE trades include the familiar constraints of power, signal conditioning, cabling, reliability, and mass, and now include considerations such as spectrum allocation and interference for wireless sensors. Our group at NASA s John C. Stennis Space Center (SSC) works in the broad area of integrated systems health management (ISHM). Core ISHM technologies include smart and intelligent sensors, anomaly detection, root cause analysis, prognosis, and interfaces to operators and other system elements [2]. Sensor technologies are the base fabric that feed data and health information to higher layers. Cost-effective operation of the complement of test stands benefits from technologies and methodologies that contribute to reductions in labor costs, improvements in efficiency, reductions in turn-around times, improved reliability, and other measures. ISHM is an active area of development at SSC because it offers the potential to achieve many of those operational goals [3-5].

Schmalzel, John↗

What Is the OPP Approach to the Next Generation of Laboratory Requirements

Planetary Protection Quality Management System NASA’s Office of Planetary Protection uses a quality-based process evaluation approach to verify planetary protection bioburden compliance over a project’s life cycle. The verification strategy shifts from a comparative direct assay approach validating hardware bioburden at a “moment in time,” to one that implements a continual quality assurance demonstration of the analytical process via established data requirements, laboratory operational, and management parameters throughout the mission’s entire assembly process. Laboratory quality-based systems and management strategies are standardized and implemented across government and industry. A standardized laboratory quality system approach increases transparency throughout the project’s life cycle and aligns planetary protection analytical approaches with government and industry practices to support both NASA and commercial endeavors. Strategies include the implementation of a laboratory quality management structure that documents and routinely validates parameters critical to experimental design and data collection, provides data quality assessment parameters, and ultimately validates that the collected data is of sufficient quality and quantity to meet the specified technical goals. Planetary protection can draw on these practices to provide a systematic process-based quality approach to support planetary protection validation and compliance requirements. Quality approaches including data quality objectives, method performance, data acceptance criteria and the associated laboratory quality management system are presented to provide an overview and framework for a planetary protection laboratory quality management system.

Amy Baker↗

Communications Contingency Plan: Planning for Crises and Controversy

Interviews were conducted with a variety of Marshall Space Flight Center personnel and local media representatives in Huntsville, Alabama, in order to identify the current perceptions of these individuals regarding communication effectiveness between MSFC and the media. The purposes of the Phase One report are to (1) assess the need for a contingency plan for communicating in situations of crisis and controversy; (2) identify goals and objectives for the planning process; and (3) provide recommendations for future planning activities to achieve the goals and objectives outlined in Phase One. It is strongly recommended that MSFC personnel who are involved in communications with the media participate in a facilitated, strategic communications planning process in order to develop Phase Two of the Communications Contingency Plan (CCP). Phase Two will address (1) the categorizing, ranking and prioritizing of crises and controversies; (2) the development of action steps and implementation strategies for the CCP; and (3) the development of a monitoring and evaluation process for ongoing plan effectiveness.

Treise, Deborah↗

NASA Johnson Space Center: Total quality partnership

The development of and benefits realized from a joint NASA, support contractor continuous improvement process at the Johnson Space Center (JSC) is traced. The joint effort described is the Safety, Reliability, and Quality Assurance Directorate relationship with its three support contractors which began in early 1990. The Continuous Improvement effort started in early 1990 with an initiative to document and simplify numerous engineering change evaluation processes. This effort quickly grew in scope and intensity to include process improvement teams, improvement methodologies, awareness, and training. By early 1991, the support contractor had teams in place and functioning, program goals established and a cultural change effort underway. In mid-l991 it became apparent that a major redirection was needed to counter a growing sense of frustration and dissatisfaction from teams and managers. Sources of frustration were isolated to insufficient joint participation on teams, and to a poorly defined vision. Over the next year, the effort was transformed to a truly joint process. The presentation covers the steps taken to define vision, values, goals, and priorities and to form a joint Steering Committee and joint process improvement teams. The most recent assessment against the President's award criteria is presented as a summary of progress. Small, but important improvement results have already demonstrated the value of the joint effort.

Harlan, Charlie↗