Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance-Based”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Training evaluation final report

In the area of management training, 'evaluation' refers both to the specific evaluation instrument used to determine whether a training effort was considered effective, and to the procedures followed to evaluate specific training requests. This report recommends to evaluate new training requests in the same way new procurement or new projects are evaluated. This includes examining training requests from the perspective of KSC goals and objectives, and determining expected ROI of proposed training program (does training result in improved productivity, through savings of time, improved outputs, and/or personnel reduction?). To determine whether a specific training course is effective, a statement of what constitutes 'good performance' is required. The user (NOT the Training Branch) must define what is 'required level of performance'. This 'model' will be the basis for the design and development of an objective, performance-based, training evaluation instrument.

Sepulveda, Jose A.↗

Telerobotic system performance measurement - Motivation and methods

A systems performance-based strategy for modeling and conducting experiments relevant to the design and performance characterization of telerobotic systems is described. A developmental testbed consisting of a distributed telerobotics network and initial efforts to implement the strategy described is presented. Consideration is given to the general systems performance theory (GSPT) to tackle human performance problems as a basis for: measurement of overall telerobotic system (TRS) performance; task decomposition; development of a generic TRS model; and the characterization of performance of subsystems comprising the generic model. GSPT employs a resource construct to model performance and resource economic principles to govern the interface of systems to tasks. It provides a comprehensive modeling/measurement strategy applicable to complex systems including both human and artificial components. Application is presented within the framework of a distributed telerobotics network as a testbed. Insight into the design of test protocols which elicit application-independent data is described.

Kondraske, George V.↗

Functional Performance of Pyrovalves

Following several flight and ground test failures of spacecraft systems using single-shot, 'normally closed' pyrotechnically actuated valves (pyrovalves), a government/industry cooperative program was initiated to assess the functional performance of five qualified designs. The goal of the program was to improve performance-based requirements for the procurement of pyrovalves. Specific objectives included the demonstration of performance test methods, the measurement of 'blowby' (the passage of gases from the pyrotechnic energy source around the activating piston into the valve's fluid path), and the quantification of functional margins for each design. Experiments were conducted in-house at NASA on several units each of the five valve designs. The test methods used for this program measured the forces and energies required to actuate the valves, as well as the energies and the pressures (where possible) delivered by the pyrotechnic sources. Functional performance ranged widely among the designs. Blowby cannot be prevented by o-ring seals; metal-to-metal seals were effective. Functional margin was determined by dividing the energy delivered by the pyrotechnic sources in excess to that required to accomplish the function by the energy required for that function. All but two designs had adequate functional margins with the pyrotechnic cartridges evaluated.

Bement, Laurence J.↗

Optimizing Input/Output Using Adaptive File System Policies

Parallel input/output characterization studies and experiments with flexible resource management algorithms indicate that adaptivity is crucial to file system performance. In this paper we propose an automatic technique for selecting and refining file system policies based on application access patterns and execution environment. An automatic classification framework allows the file system to select appropriate caching and pre-fetching policies, while performance sensors provide feedback used to tune policy parameters for specific system environments. To illustrate the potential performance improvements possible using adaptive file system policies, we present results from experiments involving classification-based and performance-based steering.

Madhyastha, Tara M.↗

Flight Evaluation of Center-TRACON Automation System Trajectory Prediction Process

Two flight experiments (Phase 1 in October 1992 and Phase 2 in September 1994) were conducted to evaluate the accuracy of the Center-TRACON Automation System (CTAS) trajectory prediction process. The Transport Systems Research Vehicle (TSRV) Boeing 737 based at Langley Research Center flew 57 arrival trajectories that included cruise and descent segments; at the same time, descent clearance advisories from CTAS were followed. Actual trajectories of the airplane were compared with the trajectories predicted by the CTAS trajectory synthesis algorithms and airplane Flight Management System (FMS). Trajectory prediction accuracy was evaluated over several levels of cockpit automation that ranged from a conventional cockpit to performance-based FMS vertical navigation (VNAV). Error sources and their magnitudes were identified and measured from the flight data. The major source of error during these tests was found to be the predicted winds aloft used by CTAS. The most significant effect related to flight guidance was the cross-track and turn-overshoot errors associated with conventional VOR guidance. FMS lateral navigation (LNAV) guidance significantly reduced both the cross-track and turn-overshoot error. Pilot procedures and VNAV guidance were found to significantly reduce the vertical profile errors associated with atmospheric and airplane performance model errors.

Williams, David H.↗

Risk Management Structured for Today's Environment

Today's project management environment provides NASA with myriad challenges. We have smaller budgets and, consequently, smaller programs and shorter lead times. We have less money for development, and no money to recover from contingencies or mishaps. The NASA Administrator is leading the Agency away from operations, instilling a renewed focus on scientific research and the development and application of new cutting-edge technologies. We are using performance-based and fixed-price contracts with industry, and we are forming more and more partnerships with the international community. In addition to the environment, we have many NASA-unique conditions that challenge mission success. They include a higher level of performance requirements, limited production numbers, higher development efforts and cost, the inability to operate a space element fully under realistic conditions on the ground, limited access to the product during operation, and, of course, the need for more science for fewer dollars and on a shorter schedule.

Michael A. Greenfield↗

Improving Student Achievement in Math and Science

As the new millennium approaches, a long anticipated reckoning for the education system of the United States is forthcoming, Years of school reform initiatives have not yielded the anticipated results. A particularly perplexing problem involves the lack of significant improvement of student achievement in math and science. Three "Partnership" projects represent collaborative efforts between Xavier University (XU) of Louisiana, Southern University of New Orleans (SUNO), Mississippi Valley State University (MVSU), and the National Aeronautics and Space Administration (NASA), Stennis Space Center (SSC), to enhance student achievement in math and science. These "Partnerships" are focused on students and teachers in federally designated rural and urban empowerment zones and enterprise communities. The major goals of the "Partnerships" include: (1) The identification and dissemination of key indices of success that account for high performance in math and science; (2) The education of pre-service and in-service secondary teachers in knowledge, skills, and competencies that enhance the instruction of high school math and science; (3) The development of faculty to enhance the quality of math and science courses in institutions of higher education; and (4) The incorporation of technology-based instruction in institutions of higher education. These goals will be achieved by the accomplishment of the following objectives: (1) Delineate significant ?best practices? that are responsible for enhancing student outcomes in math and science; (2) Recruit and retain pre-service teachers with undergraduate degrees in Biology, Math, Chemistry, or Physics in a graduate program, culminating with a Master of Arts in Curriculum and Instruction; (3) Provide faculty workshops and opportunities for travel to professional meetings for dissemination of NASA resources information; (4) Implement methodologies and assessment procedures utilizing performance-based applications of higher order thinking via the incorporation of Global Learning Observations To Benefit the Environment (GLOBE), Mission to Planet Earth and the use of Geographic Imaging Systems into the K-12th grade curriculum.

Sullivan, Nancy G.↗

Evaluation Of The NASA Quality Surveillance System Pilot In Meeting Requirements For Contractor Surveillance Under Performance Based Contracting

The use of performance-based contracting at Kennedy Space Center has necessitated a shift from intrusive oversight of contractor activities to an insight surveillance role. This paper describes the results of a pilot implementation of the NASA Quality Surveillance System (NQSS) in the Space Shuttle Main Engines Processing Facility. The NQSS is a system to sample contractor activities using documented procedures, specifications, drawings and observations of work in progress to answer the question "Is the contractor doing what they said they would do?" The concepts of the NQSS are shown to be effective in providing assurance of contractor quality. Many of the concepts proven in the pilot are being considered for incorporation into an overall KSC Quality Surveillance System.

Schmahl, Karen E.↗

Evaluation of the NASA Quality Surveillance System Pilot in Meeting Requirements for Contractor Surveillance Under Performance Based Contracting

The use of performance-based contracting at Kennedy Space Center has necessitated a shift from intrusive oversight of contractor activities to an insight surveillance role. This paper describes the results of a pilot implementation of the NASA Quality Surveillance System (NQSS) in the Space Shuttle Main Engines Processing Facility. The NQSS is a system to sample contractor activities using documented procedures, specifications, drawings and observations of work in progress to answer the question "Is the contractor doing what they said they would do?" The concepts of the NQSS are shown to be effective in providing assurance of contractor quality. Many of the concepts proven in the pilot are being considered for incorporation into an overall KSC Quality Surveillance System.

Schmahl, Karen E.↗

Rocket Engine Health Management: Early Definition of Critical Flight Measurements

The NASA led Space Launch Initiative (SLI) program has established key requirements related to safety, reliability, launch availability and operations cost to be met by the next generation of reusable launch vehicles. Key to meeting these requirements will be an integrated vehicle health management ( M) system that includes sensors, harnesses, software, memory, and processors. Such a system must be integrated across all the vehicle subsystems and meet component, subsystem, and system requirements relative to fault detection, fault isolation, and false alarm rate. The purpose of this activity is to evolve techniques for defining critical flight engine system measurements-early within the definition of an engine health management system (EHMS). Two approaches, performance-based and failure mode-based, are integrated to provide a proposed set of measurements to be collected. This integrated approach is applied to MSFC s MC-1 engine. Early identification of measurements supports early identification of candidate sensor systems whose design and impacts to the engine components must be considered in engine design.

Christenson, Rick L.↗

Reactions of Air Transport Flight Crews to Displays of Weather During Simulated Flight

Display of information in the cockpit has long been a challenge for aircraft designers. Given the limited space in which to present information, designers have had to be extremely selective about the types and amount of flight related information to present to pilots. The general goal of cockpit display design and implementation is to ensure that displays present information that is timely, useful, and helpful. This suggests that displays should facilitate the management of perceived workload, and should allow maximal situation awareness. The formatting of current and projected weather displays represents a unique challenge. As technologies have been developed to increase the variety and capabilities of weather information available to flight crews, factors such as conflicting weather representations and increased decision importance have increased the likelihood for errors. However, if formatted optimally, it is possible that next generation weather displays could allow for clearer indications of weather trends such as developing or decaying weather patterns. Important issues to address include the integration of weather information sources, flight crew trust of displayed weather information, and the teamed reactivity of flight crews to displays of weather. Past studies of weather display reactivity and formatting have not adequately addressed these issues; in part because experimental stimuli have not approximated the complexity of modern weather displays, and in part because they have not used realistic experimental tasks or participants. The goal of the research reported here was to investigate the influence of onboard and NEXRAD agreement, range to the simulated potential weather event, and the pilot flying on flight crew deviation decisions, perceived workload, and perceived situation awareness. Fifteen pilot-copilot teams were required to fly a simulated route while reacting to weather events presented in two graphical formats on a separate visual display. Measures of flight crew reactions included performance-based measures such as deviation decision accuracy, and judgment-based measures such as perceived decision confidence, workload, situation awareness, and display trust. Results demonstrated that pilots adopted a conservative reaction strategy, often choosing to deviate from weather rather than ride through it. When onboard and NEXRAD displays did not agree, flight crews reacted in a complex manner, trusting the onboard system more but using the NEXRAD system to augment their situation awareness. Distance to weather reduced situation awareness and heightened workload levels. Overall, flight crews tended to adopt a participative leadership style marked by open communication. These results suggest that future weather displays should exploit the existing benefits of NEXRAD presentation for situation awareness while retaining the display structure and logic inherent in the onboard system.

Bliss, James P.↗

Flight Test Results: CTAS Cruise/Descent Trajectory Prediction Accuracy for En route ATC Advisories

The Center/TRACON Automation System (CTAS), under development at NASA Ames Research Center, is designed to assist controllers with the management and control of air traffic transitioning to/from congested airspace. This paper focuses on the transition from the en route environment, to high-density terminal airspace, under a time-based arrival-metering constraint. Two flight tests were conducted at the Denver Air Route Traffic Control Center (ARTCC) to study trajectory-prediction accuracy, the key to accurate Decision Support Tool advisories such as conflict detection/resolution and fuel-efficient metering conformance. In collaboration with NASA Langley Research Center, these test were part of an overall effort to research systems and procedures for the integration of CTAS and flight management systems (FMS). The Langley Transport Systems Research Vehicle Boeing 737 airplane flew a combined total of 58 cruise-arrival trajectory runs while following CTAS clearance advisories. Actual trajectories of the airplane were compared to CTAS and FMS predictions to measure trajectory-prediction accuracy and identify the primary sources of error for both. The research airplane was used to evaluate several levels of cockpit automation ranging from conventional avionics to a performance-based vertical navigation (VNAV) FMS. Trajectory prediction accuracy was analyzed with respect to both ARTCC radar tracking and GPS-based aircraft measurements. This paper presents detailed results describing the trajectory accuracy and error sources. Although differences were found in both accuracy and error sources, CTAS accuracy was comparable to the FMS in terms of both meter-fix arrival-time performance (in support of metering) and 4D-trajectory prediction (key to conflict prediction). Overall arrival time errors (mean plus standard deviation) were measured to be approximately 24 seconds during the first flight test (23 runs) and 15 seconds during the second flight test (25 runs). The major source of error during these tests was found to be the predicted winds aloft used by CTAS. Position and velocity estimates of the airplane provided to CTAS by the ATC Host radar tracker were found to be a relatively insignificant error source for the trajectory conditions evaluated. Airplane performance modeling errors within CTAS were found to not significantly affect arrival time errors when the constrained descent procedures were used. The most significant effect related to the flight guidance was observed to be the cross-track and turn-overshoot errors associated with conventional VOR guidance. Lateral navigation (LNAV) guidance significantly reduced both the cross-track and turn-overshoot error. Pilot procedures and VNAV guidance were found to significantly reduce the vertical profile errors associated with atmospheric and aircraft performance model errors.

Green, S.↗

The Second SeaWiFS HPLC Analysis Round-Robin Experiment (SeaHARRE-2)

Eight international laboratories specializing in the determination of marine pigment concentrations using high performance liquid chromatography (HPLC) were intercompared using in situ samples and a variety of laboratory standards. The field samples were collected primarily from eutrophic waters, although mesotrophic waters were also sampled to create a dynamic range in chlorophyll concentration spanning approximately two orders of magnitude (0.3 25.8 mg m-3). The intercomparisons were used to establish the following: a) the uncertainties in quantitating individual pigments and higher-order variables (sums, ratios, and indices); b) an evaluation of spectrophotometric versus HPLC uncertainties in the determination of total chlorophyll a; and c) the reduction in uncertainties as a result of applying quality assurance (QA) procedures associated with extraction, separation, injection, degradation, detection, calibration, and reporting (particularly limits of detection and quantitation). In addition, the remote sensing requirements for the in situ determination of total chlorophyll a were investigated to determine whether or not the average uncertainty for this measurement is being satisfied. The culmination of the activity was a validation of the round-robin methodology plus the development of the requirements for validating an individual HPLC method. The validation process includes the measurements required to initially demonstrate a pigment is validated, and the measurements that must be made during sample analysis to confirm a method remains validated. The so-called performance-based metrics developed here describe a set of thresholds for a variety of easily-measured parameters with a corresponding set of performance categories. The aggregate set of performance parameters and categories establish a) the overall performance capability of the method, and b) whether or not the capability is consistent with the required accuracy objectives.

Source record↗

Human Factors Considerations for Area Navigation Departure and Arrival Procedures

Area navigation (RNAV) procedures are being implemented in the United States and around the world as part of a transition to a performance-based navigation system. These procedures are providing significant benefits and have also caused some human factors issues to emerge. Under sponsorship from the Federal Aviation Administration (FAA), the National Aeronautics and Space Administration (NASA) has undertaken a project to document RNAV-related human factors issues and propose areas for further consideration. The component focusing on RNAV Departure and Arrival Procedures involved discussions with expert users, a literature review, and a focused review of the NASA Aviation Safety Reporting System (ASRS) database. Issues were found to include aspects of air traffic control and airline procedures, aircraft systems, and procedure design. Major findings suggest the need for specific instrument procedure design guidelines that consider the effects of human performance. Ongoing industry and government activities to address air-ground communication terminology, design improvements, and chart-database commonality are strongly encouraged. A review of factors contributing to RNAV in-service errors would likely lead to improved system design and operational performance.

Barhydt, Richard↗

Civil Service Workforce Market Supply and the Effect on Cost Estimating Relationship (CERS) that May Effect the Productivity Factors for Future NASA Missions

The upcoming retirement of the Baby Boomers will leave a workforce age gap between the younger generation (the future NASA decision makers) and the gray beards. This paper will reflect on the average age of the workforce across NASA Centers, the Aerospace Industry and other Government Agencies, like DoD. This paper will dig into Productivity and Realization Factors and how they get applied to bi-monthly (payroll) data for true full-time equivalent (FTE) calculations that could be used at each of the NASA Centers and other business systems that are on the forefront in being implemented. This paper offers some comparative costs analysis/solutions, from simple FTE cost-estimating relationships (CERs) versus CERs for monthly time-phasing activities for small research projects that start and get completed within a government fiscal year. This paper will present the results of a parametric study investigating the cost-effectiveness of alternative performance-based CERs and how they get applied into the Center's forward pricing rate proposals (FPRP). True CERs based on the relationship of a younger aged workforce will have some effects on labor rates used in both commercial cost models and other internal home-grown cost models which may impact the productivity factors for future NASA missions.

Sterk, Steve↗

Simulation Evaluation of Equivalent Vision Technologies for Aerospace Operations

A fixed-based simulation experiment was conducted in NASA Langley Research Center s Integration Flight Deck simulator to investigate enabling technologies for equivalent visual operations (EVO) in the emerging Next Generation Air Transportation System operating environment. EVO implies the capability to achieve or even improve on the safety of current-day Visual Flight Rules (VFR) operations, maintain the operational tempos of VFR, and perhaps even retain VFR procedures - all independent of the actual weather and visibility conditions. Twenty-four air transport-rated pilots evaluated the use of Synthetic/Enhanced Vision Systems (S/EVS) and eXternal Vision Systems (XVS) technologies as enabling technologies for future all-weather operations. The experimental objectives were to determine the feasibility of XVS/SVS/EVS to provide for all weather (visibility) landing capability without the need (or ability) for a visual approach segment and to determine the interaction of XVS/EVS and peripheral vision cues for terminal area and surface operations. Another key element of the testing investigated the pilot's awareness and reaction to non-normal events (i.e., failure conditions) that were unexpectedly introduced into the experiment. These non-normal runs served as critical determinants in the underlying safety of all-weather operations. Experimental data from this test are cast into performance-based approach and landing standards which might establish a basis for future all-weather landing operations. Glideslope tracking performance appears to have improved with the elimination of the approach visual segment. This improvement can most likely be attributed to the fact that the pilots didn't have to simultaneously perform glideslope corrections and find required visual landing references in order to continue a landing. Lateral tracking performance was excellent regardless of the display concept being evaluated or whether or not there were peripheral cues in the side window. Although workload ratings were significantly less when peripheral cues were present compared to when there were none, these differences appear to be operationally inconsequential. Larger display concepts tested in this experiment showed significant situation awareness (SA) improvements and workload reductions compared to smaller display concepts. With a fixed display size, a color display was more influential in SA and workload ratings than a collimated display.

Kramer, Lynda J.↗

Safety and Quality Training Simulator

A portable system of electromechanical and electronic hardware and documentation has been developed as an automated means of instructing technicians in matters of safety and quality. The system enables elimination of most of the administrative tasks associated with traditional training. Customized, performance-based, hands-on training with integral testing is substituted for the traditional instructional approach of passive attendance in class followed by written examination.

Scobby, Pete T.↗

The Technical Work Plan Tracking Tool

The Technical Work Plan Tracking Tool is a web-based application that enables interactive communication and approval of contract requirements that pertain to the administration of the Science, Engineering, Analysis, and Test (SEAT) contract at Johnson Space Center. The implementation of the application has (1) shortened the Technical Work Plan approval process, (2) facilitated writing and documenting requirements in a performance-based environment with associated surveillance plans, (3) simplified the contractor s estimate of the cost for the required work, and (4) allowed for the contractor to document how they plan to accomplish the work. The application is accessible to over 300 designated NASA and contractor employees via two Web sites. For each employee, the application regulates access according to the employee s authority to enter, view, and/or print out diverse information, including reports, work plans, purchase orders, and financial data. Advanced features of this application include on-line approval capability, automatic e-mail notifications requesting review by subsequent approvers, and security inside and outside the firewall.

Chullen, Cinda↗