Search NASA⌕ Search

SEARCH · Search NASA

Results for “training effectiveness”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Performance assessment to enhance training effectiveness.

Training simulators have become increasingly popular tools for instructing humans on performance in complex environments. However, the question of how to provide individualized and scenario-specific assessment and feedback to students remains largely an open question. To maximize training efficiency, new technologies are required that assist instructors in providing individually relevant instruction. Sandia National Laboratories has shown the feasibility of automated performance assessment tools, such as the Sandia-developed Automated Expert Modeling and Student Evaluation (AEMASE) software, through proof-of-concept demonstrations, a pilot study, and an experiment. In the pilot study, the AEMASE system, which automatically assesses student performance based on observed examples of good and bad performance in a given domain, achieved a high degree of agreement with a human grader (89%) in assessing tactical air engagement scenarios. In more recent work, we found that AEMASE achieved a high degree of agreement with human graders (83-99%) for three Navy E-2 domain-relevant performance metrics. The current study provides a rigorous empirical evaluation of the enhanced training effectiveness achievable with this technology. In particular, we assessed whether giving students feedback based on automated metrics would enhance training effectiveness and improve student performance. We trained two groups of employees (differentiated by type of feedback) on a Navy E-2 simulator and assessed their performance on three domain-specific performance metrics. We found that students given feedback via the AEMASE-based debrief tool performed significantly better than students given only instructor feedback on two out of three metrics. Future work will focus on extending these developments for automated assessment of teamwork.

99 GENERAL AND MISCELLANEOUS↗

Using after-action review based on automated performance assessment to enhance training effectiveness.

Training simulators have become increasingly popular tools for instructing humans on performance in complex environments. However, the question of how to provide individualized and scenario-specific assessment and feedback to students remains largely an open question. In this work, we follow-up on previous evaluations of the Automated Expert Modeling and Automated Student Evaluation (AEMASE) system, which automatically assesses student performance based on observed examples of good and bad performance in a given domain. The current study provides a rigorous empirical evaluation of the enhanced training effectiveness achievable with this technology. In particular, we found that students given feedback via the AEMASE-based debrief tool performed significantly better than students given only instructor feedback on two out of three domain-specific performance metrics.

99 GENERAL AND MISCELLANEOUS↗

Effect of antiferromagnetic layer thickness on exchange bias, training effect, and magnetotransport properties in ferromagnetic/antiferromagnetic antidot arrays

The effect of antiferromagnetic (AFM) layer on exchange bias (EB), training effect, and magnetotransport properties in ferromagnetic (FM) /AFM nanoscale antidot arrays and sheet films Ag(10 nm)/Co(8 nm)/NiO(t{sub NiO})/Ag(5 nm) at 10 K is studied. The AFM layer thickness dependence of the EB field shows a peak at t{sub NiO} = 2 nm that is explained by using the random field model. The misalignment of magnetic moments in the three-dimensional antidot arrays causes smaller decrease of EB field compared with that in the sheet films for training effect. The anomalous magnetotransport properties, in particular positive magnetoresistance (MR) for antidot arrays but negative MR for sheet films are found. The training effect and magnetotransport properties are strongly affected by the three-dimensional spin-alignment effects in the antidot arrays.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Effects of Field of View and Visual Complexity on Virtual Reality Training Effectiveness for a Visual Scanning Task

Virtual reality training systems are commonly used in a variety of domains, and it is important to understand how the realism of a training simulation influences training effectiveness. The paper presents a framework for evaluating the effects of virtual reality fidelity based on an analysis of a simulation’s display, interaction, and scenario components. Following this framework, we conducted a controlled experiment to test the effects of fidelity on training effectiveness for a visual scanning task. The experiment varied the levels of field of view and visual realism during a training phase and then evaluated scanning performance with the simulator’s highest level of fidelity. To assess scanning performance, we measured target detection and adherence to a prescribed strategy. The results show that both field of view and visual realism significantly affected target detection during training; higher field of view led to better performance and higher visual realism worsened performance. Additionally, the level of visual realism during training significantly affected learning of the prescribed visual scanning strategy, providing evidence that high visual realism was important for learning the technique. The results also demonstrate that task performance during training was not always a sufficient measure of mastery of an instructed technique. That is, if learning a prescribed strategy or skill is the goal of a training exercise, performance in a simulation may not be an appropriate indicator of effectiveness outside of training—evaluation in a more realistic setting may be necessary.

97 MATHEMATICS AND COMPUTING↗

Enhanced training effectiveness using automated student assessment.

Training simulators have become increasingly popular tools for instructing humans on performance in complex environments. However, the question of how to provide individualized and scenario-specific assessment and feedback to students remains largely an open question. In this work, we follow-up on previous evaluations of the Automated Expert Modeling and Automated Student Evaluation (AEMASE) system, which automatically assesses student performance based on observed examples of good and bad performance in a given domain. The current study provides an empirical evaluation of the enhanced training effectiveness achievable with this technology. In particular, we found that students given feedback via the AEMASE-based debrief tool performed significantly better than students given only instructor feedback.

99 GENERAL AND MISCELLANEOUS↗

Industrial Energy Assessment Training Effectiveness Evaluation: An Eye-Tracking Study

It is essential to understand the effectiveness of any training program so it can be improved accordingly. Various studies have applied standard metrics for the evaluation of visual behavior to recognize the areas of interest that attract individuals’ attention as there is a high correlation between attentional behavior and where one is focusing on. However, through reviewing the literature, we believe that studies that applied eye-tracking technologies for training purposes are still limited, especially in the industrial energy assessment training field. In this paper, the effectiveness of industrial energy assessment training was quantitatively evaluated by measuring the attentional allocation of trainees using eye-tracking technology. Moreover, this study identifies the areas that require more focus based on evaluating the performance of subjects after receiving the training. Additionally, this research was conducted in a controlled environment to remove the distractions that may be caused by environmental factors to only concentrate on variables that influence the learning behavior of subjects. The experiment results showed that after receiving the training, the subjects’ performance in energy assessment was significantly improved in two areas: production, and recycling and waste management, and the designed training program enhanced the knowledge of participants in identifying energy-saving opportunities to the knowledge level of experienced participants.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Exchange Bias Training Effect in GdBaCo{sub 2}O{sub 5.5} Cobaltite

The nature of the training effect in exchange bias compounds, which consists in a decrease in the exchange bias field H{sub EB} under magnetic field cycling, is clarified. It is shown that the training effect in GdBaCo{sub 2}O{sub 5 + δ} cobaltite with δ ≈ 0.5 is caused by a decrease in magnetization. Depending on time, magnetization M(t) decreases sharply after the first cycle and slowly in subsequent N cycles. A direct relationship (proportionality) is established between the decrease in the magnetization M(t) of ferromagnetic particles and the change of the field H{sub EB}(t). It is assumed that the cooling of a sample in a magnetic field gives rise to small (single-domain) and large ferromagnetic clusters in an antiferromagnetic environment. The sharp decrease in M(t) and H{sub EB}(t) and the deviation of the function H{sub EB}(N) from the well-known power-law relation ΔH{sub EB} ∝ N{sup –1/2} with N > 1 is explained by the transformation of large ferromagnetic clusters into a multidomain state under magnetic field cycling. The results are consistent with the phenomenological model of Meiklejohn and Bean, which predicts a linear dependence of the exchange bias on the ferromagnetic magnetization of a ferromagnet/antiferromagnet structure.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Temperature dependent exchange bias training effect in single-crystalline BiFeO{sub 3}/Co bilayers

Single-crystalline BiFeO{sub 3} (BFO)/Co bilayers were prepared by combined pulsed laser deposition and magnetron sputtering on (001) SrTiO{sub 3} substrates. Exchange bias (EB) and accompanying training effect have been studied as a function of temperature (T) between 5 K and 300 K. A non-monotonic exchange field variation with sharp increase below 100 K has been observed. In the meanwhile, strong training effect was recorded when T < 100 K and it weakens monotonically with increasing T up to 300 K. These temperature dependent EB and training effect may be caused by the uncompensated spins in both the interfacial spin-glass (SG) phase at low temperature and the antiferromagnetic BFO layer at higher temperature. The low temperature EB training results can be well fitted by a modified Binek's model considering asymmetric changes of the pinning SG spins at the descending and the ascending branches.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Training effectiveness assessment: Methodological problems and issues

The U.S. military uses a large number of simulators to train and sustain the flying skills of helicopter pilots. Despite the enormous resources required to purchase, maintain, and use those simulators, little effort has been expended in assessing their training effectiveness. One reason for this is the lack of an evaluation methodology that yields comprehensive and valid data at a practical cost. Some of these methodological problems and issues that arise in assessing simulator training effectiveness, as well as problems with the classical transfer-of-learning paradigm were discussed.

Cross, Kenneth D.↗

A separation of antiferromagnetic spin motion modes in the training effect of exchange biased Co/CoO film with in-plane anisotropy

The motion of antiferromagnetic interfacial spins is investigated through the temperature evolution of training effect in a Co/CoO film with in-plane biaxial anisotropy. Significant differences in the training effect and its temperature dependence are observed in the magnetic easy axis and hard axis (HA) and ascribed to the different motion modes of antiferromagnetic interfacial spins, the collective spin cluster rotation (CSR) and the single spin reversal (SSR), caused by different magnetization reversal modes of ferromagnetic layer. These motion modes of antiferromagnetic spins are successfully separated using a combination of an exponential function and a classic n{sup −1/2} function. A larger CSR to SSR ratio and a shorter lifetime of CSR found in the HA indicates that the domain rotation in the ferromagnetic layer tends to activate and accelerate a CSR mode in the antiferromagnetic spins.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Enhancement of exchange bias and training effect in ion-beam sputtered Fe{sub 46}Mn{sub 54}/Ni{sub 81}Fe{sub 19} bilayers

We present a remarkable enhancement by 300% of the exchange-bias field at room temperature, without affecting the coercivity value, via optimum magnetic annealing (250 °C/3 kOe) in ion-beam sputtered FeMn(30 nm)/NiFe(10 nm) bilayers. This specific behavior has been attributed to a higher degree of γ-FeMn(111) orientation that offers more interfacial FeMn moments to get pinned with the moments of the adjacent NiFe layer. Unlike the absence of training effect at room temperature, a pronounced training effect and an accompanying magnetization reversal asymmetry are evidenced upon field cooling below 50 K due to the presence of biaxial exchange induced anisotropy across the interdiffused FeMn/NiFe interface. The present findings not only have technological significance but also are of relevance to the understanding of interfacial spin disorder and frustration in these exchange-biased systems.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

An evaluation of training effectiveness of an intelligent tutoring system

The study evaluated the training effectiveness of an intelligent tutoring system (ITS) for the Remote Manipulator System (RMS). The study examined how well individuals learn the training content and skills from the RMS ITS and to what extent the content and skills learned using the ITS transfer to RMS task performance in the SES, a high fidelity simulator. Three astronauts completed 8 2-hour ITS sessions addressing movement in three coordinate systems, grapple, ungrapple, berth, and unberth procedures, and singularities and reach limits. Their performance was also observed in an SES training session. Performance data were collected using multiple measures: ITS task performance, transfer performance on the SES, a conceptual knowledge test, an opinion survey completed by astronauts, and comments and observations from astronauts and trainers. Results indicated the RMS ITS to be moderately effective and provided evidence of the efficacy of ITS's, in general. Comments and suggestions are provided relating to how the ITS could be improved and to enable decision makers to judge the effectiveness of the RMS ITS.

Johnson, Debra Steele↗

Development and Utility of a Piloted Flight Simulator for Icing Effects Training

A piloted flight simulator called the Ice Contamination Effects Flight Training Device (ICEFTD), which uses low cost desktop components and a generic cockpit replication is being developed. The purpose of this device is to demonstrate the effectiveness of its use for training pilots to recognize and recover from aircraft handling anomalies that result from airframe ice formations. High-fidelity flight simulation models for various baseline (non-iced) and iced configurations were developed from wind tunnel tests of a subscale DeHavilland DHC-6 Twin Otter aircraft model. These simulation models were validated with flight test data from the NASA Twin Otter Icing Research Aircraft, which included the effects of ice on wing and tail stall characteristics. These simulation models are being implemented into an ICEFTD that will provide representative aircraft characteristics due to airframe icing. Scenario-based exercises are being constructed to give an operational-flavor to the simulation. Training pilots will learn to recognize iced aircraft characteristics from the baseline, and will practice and apply appropriate recovery procedures to a handling event.

Ratvasky, Thomas P.↗

Training effectiveness assessment: Where are we?

Over 9,000 pilot training courses have been conducted at FSI using the Bell 222 and Sikorsky S-76 simulators. Through the use of FAA exemptions, these simulators can be used for certain training and checking credit. The history of the development and use of commercial helicopter simulators and the opportunities for their increased utilization and use were explored.

Mcgowan, Greg↗

Evaluating the Impact of Head Rotation Amplification on Virtual Reality Training Effectiveness

Virtual reality (VR) systems have been proposed for use in numerous training scenarios, such as room clearing, which require the trainee to maintain spatial awareness. But many VR training systems lack a fully surrounding display, requiring trainees to use a combination of physical and virtual turns to view the environment, thus decreasing spatial awareness. One solution to this problem is to amplify head rotations, such that smaller physical turns are mapped to larger virtual turns, allowing trainees to view the surrounding environment with head movements alone. For example, in a multi-monitor system covering only a 90-degree field of regard, head rotations could be amplified four times to allow the user to see the entire 360-degree surrounding environment. This solution is attractive because it can be used with lower-cost VR systems and does not require virtual turning. However, the effects of amplified head rotations on spatial awareness and training transfer are not well understood. We hypothesized that small amounts of amplification might be tolerable, but that larger amplifications might cause trainees to become disoriented and to have decreased task performance and training transfer. In this paper, we will present our findings from an experiment designed to investigate these hypotheses. The experiment placed users in a virtual warehouse and asked them to move from room to room, counting objects placed around them in space. We varied the amount of amplification applied during these trials, and also varied the type of display used (head-mounted display or CAVE). We measured task performance and spatial awareness. We then assessed training transfer in an assessment environment with a fully surrounding display and no amplification. The results of this study will inform VR training system developers about the potential negative effects of using head rotation amplification and contribute to more effective VR training system design.

3D interaction↗

Effective Training for Flight in Icing Conditions

The development of a piloted flight simulator called the Ice Contamination Effects Flight Training Device (ICEFTD) was recently completed. This device demonstrates the ability to accurately represent an iced airplane s flight characteristics and is utilized to train pilots in recognizing and recovering from aircraft handling anomalies that result from airframe ice formations. The ICEFTD was demonstrated at three recent short courses hosted by the University of Tennessee Space Institute. It was also demonstrated to a group of pilots at the National Test Pilot School. In total, eighty-four pilots and flight test engineers from industry and the regulatory community spent approximately one hour each in the ICEFTD to get a "hands on" lesson of an iced airplane s reduced performance and handling qualities. Additionally, pilot cues of impending upsets and recovery techniques were demonstrated. The purpose of this training was to help pilots understand how ice contamination affects aircraft handling so they may apply that knowledge to the operations of other aircraft undergoing testing and development. Participant feedback on the ICEFTD was very positive. Pilots stated that the simulation was very valuable, applicable to their occupations, and provided a safe way to explore the flight envelope. Feedback collected at each demonstration was also helpful to define additional improvements to the ICEFTD; many of which were then implemented in subsequent demonstrations.

Barnhart, Billy P.↗

Analysis of Pilot Monitoring Skills and a Review of Training Effectiveness

The commercial aviation industry world-wide has identified a need for improved pilot monitoring and awareness (e.g., FAA, 2013, ICAO, 2016). More specifically, aviation safety data indicate that failures in pilots’ flight path management (FPM) monitoring and awareness have contributed to a range of undesired outcomes: accidents, major upsets, and non-compliance with air traffic control (ATC) guidance. The Federal Aviation Administration (FAA) has further stated that these types of FPM failures are likely to worsen with the increasingly complex air traffic control systems and FPM concepts proposed for NextGen (https://www.faa. gov/nextgen/what_is_nextgen/) operations (e.g., see Hah et al., 2017). Adding to this complexity is the introduction of increasingly automated aircraft systems that can increase monitoring burdens. One potential mitigation for this situation is to enhance pilot training for effective monitoring. NASA Ames Research Center was asked to identify and evaluate training approaches that have the potential to enhance pilots’ ability to effectively monitor for FPM (with the result of improved awareness). The focus of this work is to identify, develop or validate training guidance to improve pilot monitoring/awareness regarding FPM and mitigate the recent trend of accidents and incidents, especially loss of control (LOC) events. The result of this work should be input for improved industry standards and FAA guidance to reduce the risk of incidents and accidents due to inadequate pilot monitoring/awareness. This is the first of three reports that were developed for this project.

aviation human factors↗

Piloted Flight Simulator Developed for Icing Effects Training

In an effort to expand pilot training methods to avoid icing-related accidents, the NASA Glenn Research Center and Bihrle Applied Research Inc. have developed the Ice Contamination Effects Flight Training Device (ICEFTD). ICEFTD simulates the flight characteristics of the NASA Twin Otter Icing Research Aircraft in a no-ice baseline and in two ice configurations simulating ice-protection-system failures. Key features of the training device are the force feedback in the yoke, the instrument panel and out-the-window graphics, the instructor s workstation, and the portability of the unit.

Ratvasky, Thomas P.↗