Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

An Evaluation Methodology for Traffic Awareness Displays

An evaluation methodology for traffic awareness displays for helicopters and other vertical/short takeoff aircraft was developed. Pilots of vertical/short takeoff aircraft wil1 require more traffic information than would pilots of conventional aircraft to avoid both other vertical/short takeoff traffic and conventional traffic. The BF Goodrich Skywatch traffic advisory display was used as a candidate display to develop a procedure for evaluating the usefulness of such displays. Four high-time helicopter pilots participated in a 16-hour flight evaluation. They flew a closed circuit in the San Francisco Bay Area. In one-half of the flights the evaluation pilot had the traffic advisory display as an aid in detecting and locating traffic. In the other half of the flights the traffic advisory display was not available to the evaluation pilot. Data examined include measures of traffic advisory display performance and pilot performance in detecting traffic, as well as subjective workload and situation awareness data. The traffic advisory system did not help the pilots to detect more traffic. The importance of detection to traffic awareness is discussed.

DeMaio, Joe↗

Evaluation of shoulder integrity in space: first report of musculoskeletal US on the International Space Station

Investigative procedures were approved by Henry Ford Human Investigation Committee and NASA Johnson Space Center Committee for Protection of Human Subjects. Informed consent was obtained. Authors evaluated ability of nonphysician crewmember to obtain diagnostic-quality musculoskeletal ultrasonographic (US) data of the shoulder by following a just-in-time training algorithm and using real-time remote guidance aboard the International Space Station (ISS). ISS Expedition-9 crewmembers attended a 2.5-hour didactic and hands-on US training session 4 months before launch. Aboard the ISS, they completed a 1-hour computer-based Onboard Proficiency Enhancement program 7 days before examination. Crewmembers did not receive specific training in shoulder anatomy or shoulder US techniques. Evaluation of astronaut shoulder integrity was done by using a Human Research Facility US system. Crew used special positioning techniques for subject and operator to facilitate US in microgravity environment. Common anatomic reference points aided initial probe placement. Real-time US video of shoulder was transmitted to remote experienced sonologists in Telescience Center at Johnson Space Center. Probe manipulation and equipment adjustments were guided with verbal commands from remote sonologists to astronaut operators to complete rotator cuff evaluation. Comprehensive US of crewmember's shoulder included transverse and longitudinal images of biceps and supraspinatus tendons and articular cartilage surface. Total examination time required to guide astronaut operator to acquire necessary images was approximately 15 minutes. Multiple arm and probe positions were used to acquire dynamic video images that were of excellent quality to allow evaluation of shoulder integrity. Postsession download and analysis of high-fidelity US images collected onboard demonstrated additional anatomic detail that could be used to exclude subtle injury. Musculoskeletal US can be performed in space by minimally trained operators by using remote guidance. This technique can be used to evaluate shoulder integrity in symptomatic crewmembers after strenuous extravehicular activities or to monitor microgravity-associated changes in musculoskeletal anatomy. Just-in-time training, combined with remote experienced physician guidance, may provide a useful approach to complex medical tasks performed by nonexperienced personnel in a variety of remote settings, including current and future space programs. (c) RSNA, 2004.

Space Flight/education↗

Lithium-Ion Batteries Being Evaluated for Low-Earth-Orbit Applications

The performance characteristics and long-term cycle life of aerospace lithium-ion (Li-ion) batteries in low-Earth-orbit applications are being investigated. A statistically designed test using Li-ion cells from various manufacturers began in September 2004 to study the effects of temperature, end-of-charge voltage, and depth-of-discharge operating conditions on the cycle life and performance of these cells. Performance degradation with cycling is being evaluated, and performance characteristics and failure modes are being modeled statistically. As technology improvements are incorporated into aerospace Li-ion cells, these new designs can be added to the test to evaluate the effect of the design changes on performance and life. Cells from Lithion and Saft have achieved over 2000 cycles under 10 different test condition combinations and are being evaluated. Cells from Mine Safety Appliances (MSA) and modules made up of commercial-off-the-shelf 18650 Li-ion cells connected in series/parallel combinations are scheduled to be added in the summer of 2005. The test conditions include temperatures of 10, 20, and 30 C, end-of-charge voltages of 3.85, 3.95, and 4.05 V, and depth-of-discharges from 20 to 40 percent. The low-Earth-orbit regime consists of a 55 min charge, at a constant-current rate that is 110 percent of the current required to fully recharge the cells in 55 min until the charge voltage limit is reached, and then at a constant voltage for the remaining charge time. Cells are discharged for 35 min at the current required for their particular depth-of-discharge condition. Cells are being evaluated in four-cell series strings with charge voltage limits being applied to individual cells by the use of charge-control units designed and produced at the NASA Glenn Research Center. These charge-control units clamp the individual cell voltages as each cell reaches its end-of-charge voltage limit, and they bypass the excess current from that cell, while allowing the full current flow to the remaining cells in the pack. The goal of this evaluation is to identify conditions and cell designs for Li-ion technology that can achieve more than 30,000 low-Earth-orbit cycles. Testing is being performed at the Naval Surface Warfare Center, Crane Division, in Crane, Indiana.

McKissock, Barbara I.↗

An Evaluation of the Vapor Phase Catalytic Ammonia Removal Process for Use in a Mars Transit Vehicle

An experimental program has been developed to evaluate the potential of the Vapor Phase Catalytic Ammonia Reduction (VPCAR) technology for use as a Mars Transit Vehicle water purification system. Design modifications which will be required to ensure proper operation of the VPCAR system in reduced gravity are also evaluated. The VPCAR system is an integrated wastewater treatment technology that combines a distillation process with high temperature catalytic oxidation. The distillation portion of the system utilizes a vapor compression distillation process to provide an energy efficient phase change separation. This portion of the system removes any inorganic salts and large molecular weight, organic contaminates, i.e., non-volatile, from the product water stream and concentrates these contaminates into a byproduct stream. To oxidize the volatile organic compounds and ammonia, a vapor phase, high temperature catalytic oxidizer is used. This catalytic system converts these compounds along with the aqueous product into CO2, H2O, and N2O. A secondary catalytic bed can then be used to reduce the N2O to nitrogen and oxygen (although not evaluated in this study). This paper describes the design specification of the VPCAR process, the relative benefits of its utilization in a Mars Transit Vehicle, and the design modification which will be required to ensure its proper operation in reduced gravity. In addition, the results of an experimental evaluation of the processors is presented. This evaluation presents the processors performance based upon product water purity, water recovery rates, and power.

Flynn, Michael↗

Simple and Efficient Numerical Evaluation of Near-Hypersingular Integrals

Recently, significant progress has been made in the handling of singular and nearly-singular potential integrals that commonly arise in the Boundary Element Method (BEM). To facilitate object-oriented programming and handling of higher order basis functions, cancellation techniques are favored over techniques involving singularity subtraction. However, gradients of the Newton-type potentials, which produce hypersingular kernels, are also frequently required in BEM formulations. As is the case with the potentials, treatment of the near-hypersingular integrals has proven more challenging than treating the limiting case in which the observation point approaches the surface. Historically, numerical evaluation of these near-hypersingularities has often involved a two-step procedure: a singularity subtraction to reduce the order of the singularity, followed by a boundary contour integral evaluation of the extracted part. Since this evaluation necessarily links basis function, Green s function, and the integration domain (element shape), the approach ill fits object-oriented programming concepts. Thus, there is a need for cancellation-type techniques for efficient numerical evaluation of the gradient of the potential. Progress in the development of efficient cancellation-type procedures for the gradient potentials was recently presented. To the extent possible, a change of variables is chosen such that the Jacobian of the transformation cancels the singularity. However, since the gradient kernel involves singularities of different orders, we also require that the transformation leaves remaining terms that are analytic. The terms "normal" and "tangential" are used herein with reference to the source element. Also, since computational formulations often involve the numerical evaluation of both potentials and their gradients, it is highly desirable that a single integration procedure efficiently handles both.

Fink, Patrick W.↗

In-Flight Validation of a Pilot Rating Scale for Evaluating Failure Transients in Electronic Flight Control Systems

Engineering development and qualification of a Research Flight Control System (RFCS) for the Rotorcraft Aircrew Systems Concepts Airborne Laboratory (RASCAL) JUH-60A has motivated the development of a pilot rating scale for evaluating failure transients in fly-by-wire flight control systems. The RASCAL RFCS includes a highly-reliable, dual-channel Servo Control Unit (SCU) to command and monitor the performance of the fly-by-wire actuators and protect against the effects of erroneous commands from the flexible, but single-thread Flight Control Computer. During the design phase of the RFCS, two piloted simulations were conducted on the Ames Research Center Vertical Motion Simulator (VMS) to help define the required performance characteristics of the safety monitoring algorithms in the SCU. Simulated failures, including hard-over and slow-over commands, were injected into the command path, and the aircraft response and safety monitor performance were evaluated. A subjective Failure/Recovery Rating (F/RR) scale was developed as a means of quantifying the effects of the injected failures on the aircraft state and the degree of pilot effort required to safely recover the aircraft. A brief evaluation of the rating scale was also conducted on the Army/NASA CH-47B variable stability helicopter to confirm that the rating scale was likely to be equally applicable to in-flight evaluations. Following the initial research flight qualification of the RFCS in 2002, a flight test effort was begun to validate the performance of the safety monitors and to validate their design for the safe conduct of research flight testing. Simulated failures were injected into the SCU, and the F/RR scale was applied to assess the results. The results validate the performance of the monitors, and indicate that the Failure/Recovery Rating scale is a very useful tool for evaluating failure transients in fly-by-wire flight control systems.

Kalinowski, Kevin F.↗

Evaluation of Radiation Belt Space Weather Forecasts for Internal Charging Analyses

A variety of static electron radiation belt models, space weather prediction tools, and energetic electron datasets are used by spacecraft designers and operations support personnel as internal charging code inputs to evaluate electrostatic discharge risks in space systems due to exposure to relativistic electron environments. Evaluating the environment inputs is often accomplished by comparing whether the data set or forecast tool reliability predicts measured electron flux (or fluence over a given period) for some chosen period. While this technique is useful as a model metric, it does not provide the information necessary to evaluate whether short term deviances of the predicted flux is important in the charging evaluations. In this paper, we use a 1-D internal charging model to compute electric fields generated in insulating materials as a function of time when exposed to relativistic electrons in the Earth's magnetosphere. The resulting fields are assumed to represent the "true" electric fields and are compared with electric field values computed from relativistic electron environments derived from a variety of space environment and forecast tools. Deviances in predicted fields compared to the "true" fields which depend on insulator charging time constants will be evaluated as a potential metric for determining the importance of predicted and measured relativistic electron flux deviations over a range of time scales.

Minow, Joseph I.↗

Evaluation of Long-Term Cloud-Resolving Model Simulations Using Satellite Radiance Observations and Multi-Frequency Satellite Simulators

This paper proposes a methodology known as the Tropical Rainfall Measuring Mission (TRMM) Triple-Sensor Three-step Evaluation Framework (T3EF) for the systematic evaluation of precipitating cloud types and microphysics in a cloud-resolving model (CRM). T3EF utilizes multi-frequency satellite simulators and novel statistics of multi-frequency radiance and backscattering signals observed from the TRMM satellite. Specifically, T3EF compares CRM and satellite observations in the form of combined probability distributions of precipitation radar (PR) reflectivity, polarization-corrected microwave brightness temperature (Tb), and infrared Tb to evaluate the candidate CRM. T3EF is used to evaluate the Goddard Cumulus Ensemble (GCE) model for cases involving the South China Sea Monsoon Experiment (SCSMEX) and Kwajalein Experiment (KWAJEX). This evaluation reveals that the GCE properly captures the satellite-measured frequencies of different precipitating cloud types in the SCSMEX case but underestimates the frequencies of deep convective and deep stratiform types in the KWAJEX case. Moreover, the GCE tends to simulate excessively large and abundant frozen condensates in deep convective clouds as inferred from the overestimated GCE-simulated radar reflectivities and microwave Tb depressions. Unveiling the detailed errors in the GCE s performance provides the best direction for model improvements.

Matsui, Toshihisa↗

TurboTech Technical Evaluation Automated System

TurboTech software is a Web-based process that simplifies and semiautomates technical evaluation of NASA proposals for Contracting Officer's Technical Representatives (COTRs). At the time of this reporting, there have been no set standards or systems for training new COTRs in technical evaluations. This new process provides boilerplate text in response to interview style questions. This text is collected into a Microsoft Word document that can then be further edited to conform to specific cases. By providing technical language and a structured format, TurboTech allows the COTRs to concentrate more on the actual evaluation, and less on deciding what language would be most appropriate. Since the actual word choice is one of the more time-consuming parts of a COTRs job, this process should allow for an increase in quantity of proposals evaluated. TurboTech is applicable to composing technical evaluations of contractor proposals, task and delivery orders, change order modifications, requests for proposals, new work modifications, task assignments, as well as any changes to existing contracts.

Tiffany, Dorothy J.↗

Evaluating Algorithm Performance Metrics Tailored for Prognostics

Prognostics has taken a center stage in Condition Based Maintenance (CBM) where it is desired to estimate Remaining Useful Life (RUL) of the system so that remedial measures may be taken in advance to avoid catastrophic events or unwanted downtimes. Validation of such predictions is an important but difficult proposition and a lack of appropriate evaluation methods renders prognostics meaningless. Evaluation methods currently used in the research community are not standardized and in many cases do not sufficiently assess key performance aspects expected out of a prognostics algorithm. In this paper we introduce several new evaluation metrics tailored for prognostics and show that they can effectively evaluate various algorithms as compared to other conventional metrics. Specifically four algorithms namely; Relevance Vector Machine (RVM), Gaussian Process Regression (GPR), Artificial Neural Network (ANN), and Polynomial Regression (PR) are compared. These algorithms vary in complexity and their ability to manage uncertainty around predicted estimates. Results show that the new metrics rank these algorithms in different manner and depending on the requirements and constraints suitable metrics may be chosen. Beyond these results, these metrics offer ideas about how metrics suitable to prognostics may be designed so that the evaluation procedure can be standardized. 1

Saxena, Abhinav↗

VIIRS Product Evaluation at the Ocean PEATE

The National Polar-orbiting Operational Environmental Satellite System (NPOESS) Preparatory Project (NPP) mission will support the continuation of climate records generated from NASA missions. The NASA Science Data Segment (SDS) relies upon discipline-specific centers of expertise to evaluate the NPP data products for suitability as climate data records, The Ocean Product Evaluation and Analysis Tool Element (PEATE) will build upon Well established NASA capabilities within the Ocean Color program in order to evaluate the NPP Visible and Infrared Imager/Radiometer Suite (VIIRS) Ocean Color and Chlorophyll data products. The specific evaluation methods will support not only the evaluation of product quality but also the sources of differences with existing data records.

Patt, Frederick S.↗

Operational Concept Evaluation of Solid Oxide Fuel Cells for Space Vehicle Applications

With the end of the Space Shuttle Program, NASA is evaluating many different technologies to support future missions. Green propellants, like liquid methane and liquid oxygen, have potential advantages for some applications. A Lander propelled with LOX/methane engines is one such application. When the total vehicle design and infrastructure are considered, the advantages of the integration of propulsion, heat rejection, life support and power generation become attractive for further evaluation. Scavenged residual propellants from the propulsion tanks could be used to generate needed electric power, heat and water with a Solid Oxide Fuel Cell(SOFC). In-Situ Resource Utilization(ISRU) technologies may also generate quantities of green propellants to refill these tanks and/or supply these fuel cells. Technology demonstration projects such as the Morpheus Lander are currently underway to evaluate the practicality of such designs and operational concepts. Tethered tests are currently in progress on this vertical test bed to evaluate the propulsion and avionics systems. Evaluation of the SOFC seeks to determine the feasibility of using these green propellants to supply power and identify the limits to the integration of this technology into a space vehicle prototype.

Poast, Kenneth I.↗

Evaluation of the VIIRS Land Algorithms at Land PEATE

The Land Product Evaluation and Algorithm Testing Element (Land PEATE), a component of the Science Data Segment of the National Polar-orbiting Operational Environmental Satellite System (NPOESS) Preparatory Project (NPP), is being developed at the NASA Goddard Space Flight Center (GSFC). The primary task of the Land PEATE is to assess the quality of the Visible Infrared Imaging Radiometer Suite (VIIRS) Land data products made by the Interface Data Processing System (IDPS) using the Operational (OPS) Code during the NPP era and to recommend improvements to the algorithms in the IDPS OPS code. The Land PEATE uses a version of the MODIS Adaptive Processing System (MODAPS), NPPDAPS, that has been modified to produce products from the IDPS OPS code and software provided by the VIIRS Science Team, and uses the MODIS Land Data Operational Product Evaluation (LDOPE) team for evaluation of the data records generated by the NPPDAPS. Land PEATE evaluates the algorithms by comparing data products generated using different versions of the algorithm and also by comparing to heritage products generated from different instrument such as MODIS using various quality assessment tools developed at LDOPE. This paper describes the Land PEATE system and some of the approaches used by the Land PEATE for evaluating the VIIRS Land algorithms during the pre-launch period of the NPP mission and the proposed plan for long term monitoring of the quality of the VIIRS Land products post-launch.

Wolfe, Robert E.↗

Voluntary Consensus Organization Standards for Nondestructive Evaluation of Thin-Walled Metallic Liners and Composite Overwraps in Composite Overwrapped Pressure Vessels

NASA fracture control requirements outlined in NASA-STD-5009 and NASA-STD-5014 are predicated on the availability and use of sensitive nondestructive evaluation (NDE) methods that can detect and monitor defects, thereby providing data that can be used to predict failure or reduce the risk of failure in fracture critical components. However, in the case of composite materials and components, including composite overwrapped pressure vessels (COPVs), the effect of defects is poorly understood, the NDE methods used to evaluate locate and size defects are typically at lower technical readiness level than analogous NDE methods used for metals, and demonstration studies to verify the probability of detection (POD) are generally lacking or unavailable. These factors together make failure prediction of fracture critical composite materials and components based on size, quantity, or orientation of defects nearly impossible. Also, when inspecting metal liners in as-manufactured COPVs, sensitivity is lost and only the inner surface of the liner is accessible. Also, NDE of COPVs as applied during manufacturing varies significantly from manufacturer to manufacturer and has not yet been standardized. Although requirements exist to perform NDE immediately after manufacturing to establish initial integrity of the parts, procedural detail for NDE of composites is still nonexistent or under development. For example, in practice, only a visual inspection of COPVs is performed during manufacturing and service, leaving in question whether defects of concern, for example, bridging, overwrap winding anomalies, impact damage below visible threshold, out-of-family strain growth, and liner buckling have been adequately detected and monitored. To address these shortcomings, in 2005 the NASA Nondestructive Evaluation Working Group (NNWG) began funding work to develop and adopt standards for nondestructive evaluation of aerospace composites in collaboration with the American Society for Testing and Materials (ASTM) Committee E07 on Nondestructive Testing. Similarly, in 2006 the NASA Engineering and Safety Center (NESC) recommended that nondestructive evaluation methods that can predict composite failure in COPVs should be developed and verified, and integrated into the damage control plan for these vessels

Waller, Jess↗

SRT Evaluation of AIRS Version-6.02 and Version-6.02 AIRS Only (6.02 AO) Products

Version-6 contains a number of significant improvements over Version-5. This report compares Version-6 products resulting from the advances listed below to those from Version-5. 1. Improved methodology to determine skin temperature (T(sub s)) and spectral emissivity (Epsilon(sub v)). 2. Use of Neural-net start-up state. 3. Improvements which decrease the spurious negative Version-5 trend in tropospheric temperatures. 4. Improved QC methodology. Version-6 uses separate QC thresholds optimized for Data Assimilation (QC=0) and Climate applications (QC=0,1) respectively. 5. Channel-by-channel clear-column radiances R-hat(sub tau) QC flags. 6. Improved cloud parameter retrieval algorithm. 7. Improved OLR RTA. Our evaluation compared V6.02 and V6.02 AIRS Only (V6.02 AO) Quality Controlled products with those of Version-5.0. In particular we evaluated surface skin temperature T(sub s), surface spectral emissivity Epsilon(sub v), temperature profile T(p), water vapor profile q(p), OLR, OLR(sub CLR), effective cloud fraction alpha-Epsilon, and cloud cleared radiances R-hat(sub tau) . We conducted two types of evaluations. The first compared results on 7 focus days to collocated ECMWF truth. The seven focus days are: September 6, 2002; January 25, 2003; September 29, 2004; August 5, 2005; February 24, 2007; August 10, 2007; and May 30, 2010. In these evaluations, we show results for T(sub s), Epsilon(sub v), T(p), and q(p) in terms of yields, and RMS differences and biases with regard to ECMWF. We also show yield trends as well as bias trends of these quantities relative to ECMWF truth. We also show yields and accuracy of channel by channel QC d values of R-hat(sub tau) for V6.02 and V6.02 AO. Version-5 did not contain channel by channel QC d values of R-hat(sub tau). In the second type of evaluation, we compared V6.03 monthly mean Level-3 products to those of Version-5.0, for four different months: January, April, July, and October; in 3 different years 2003, 2007, and 2011. In particular, we compared V6.03 and V5.0 trends of T(p), q(p), alpha-Epsilon, OLR, and OLR(sub CLR) computed based on results for these 12 time periods

Susskind, Joel↗

Evaluation of Algorithms for a Miles-in-Trail Decision Support Tool

Four machine learning algorithms were prototyped and evaluated for use in a proposed decision support tool that would assist air traffic managers as they set Miles-in-Trail restrictions. The tool would display probabilities that each possible Miles-in-Trail value should be used in a given situation. The algorithms were evaluated with an expected Miles-in-Trail cost that assumes traffic managers set restrictions based on the tool-suggested probabilities. Basic Support Vector Machine, random forest, and decision tree algorithms were evaluated, as was a softmax regression algorithm that was modified to explicitly reduce the expected Miles-in-Trail cost. The algorithms were evaluated with data from the summer of 2011 for air traffic flows bound to the Newark Liberty International Airport (EWR) over the ARD, PENNS, and SHAFF fixes. The algorithms were provided with 18 input features that describe the weather at EWR, the runway configuration at EWR, the scheduled traffic demand at EWR and the fixes, and other traffic management initiatives in place at EWR. Features describing other traffic management initiatives at EWR and the weather at EWR achieved relatively high information gain scores, indicating that they are the most useful for estimating Miles-in-Trail. In spite of a high variance or over-fitting problem, the decision tree algorithm achieved the lowest expected Miles-in-Trail costs when the algorithms were evaluated using 10-fold cross validation with the summer 2011 data for these air traffic flows.

Bloem, Michael↗

Evaluation of Underwater Adhesives and Friction Coatings for In Situ Attachment of Fiber Optic Sensor System for Subsea Applications

Integrity and performance monitoring of subsea pipelines and structures provides critical information for managing offshore oil and gas production operation and preventing environmentally damaging and costly catastrophic failure. Currently pipeline monitoring devices require ground assembly and installation prior to the underwater deployment of the pipeline. A monitoring device that could be installed in situ on the operating underwater structures could enhance the productivity and improve the safety of current offshore operation. Through a Space Act Agreement (SAA) between the National Aeronautics and Space Administration (NASA) Johnson Space Center (JSC) and Astro Technology, Inc. (ATI), JSC provides technical expertise and testing facilities to support the development of fiber optic sensor technologies by ATI. This paper details the first collaboration effort between NASA JSC and ATI in evaluating underwater applicable adhesives and friction coatings for attaching fiber optic sensor system to subsea pipeline. A market survey was conducted to examine different commercial ]off ]the ]shelf (COTS) underwater adhesive systems and to select adhesive candidates for testing and evaluation. Four COTS epoxy based underwater adhesives were selected and evaluated. The adhesives were applied and cured in simulated seawater conditions and then evaluated for application characteristics and adhesive strength. The adhesive that demonstrated the best underwater application characteristics and highest adhesive strength were identified for further evaluation in developing an attachment system that could be deployed in the harsh subsea environment. Various friction coatings were also tested in this study to measure their shear strengths for a mechanical clamping design concept for attaching fiber optic sensor system. A COTS carbide alloy coating was found to increase the shear strength of metal to metal clamping interface by up to 46 percent. This study provides valuable data for assessing the feasibility of developing the next generation fiber optic senor system that could be retrofitted onto existing subsea pipeline structures.

Tang, Henry H.↗

Modeling and Evaluating Pilot Performance in NextGen: Review of and Recommendations Regarding Pilot Modeling Efforts, Architectures, and Validation Studies

NextGen operations are associated with a variety of changes to the national airspace system (NAS) including changes to the allocation of roles and responsibilities among operators and automation, the use of new technologies and automation, additional information presented on the flight deck, and the entire concept of operations (ConOps). In the transition to NextGen airspace, aviation and air operations designers need to consider the implications of design or system changes on human performance and the potential for error. To ensure continued safety of the NAS, it will be necessary for researchers to evaluate design concepts and potential NextGen scenarios well before implementation. One approach for such evaluations is through human performance modeling. Human performance models (HPMs) provide effective tools for predicting and evaluating operator performance in systems. HPMs offer significant advantages over empirical, human-in-the-loop testing in that (1) they allow detailed analyses of systems that have not yet been built, (2) they offer great flexibility for extensive data collection, (3) they do not require experimental participants, and thus can offer cost and time savings. HPMs differ in their ability to predict performance and safety with NextGen procedures, equipment and ConOps. Models also vary in terms of how they approach human performance (e.g., some focus on cognitive processing, others focus on discrete tasks performed by a human, while others consider perceptual processes), and in terms of their associated validation efforts. The objectives of this research effort were to support the Federal Aviation Administration (FAA) in identifying HPMs that are appropriate for predicting pilot performance in NextGen operations, to provide guidance on how to evaluate the quality of different models, and to identify gaps in pilot performance modeling research, that could guide future research opportunities. This research effort is intended to help the FAA evaluate pilot modeling efforts and select the appropriate tools for future modeling efforts to predict pilot performance in NextGen operations.

pilot human performance models↗