Search NASA⌕ Search

SEARCH · Search NASA

Results for “training effectiveness”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Performance assessment to enhance training effectiveness.

Training simulators have become increasingly popular tools for instructing humans on performance in complex environments. However, the question of how to provide individualized and scenario-specific assessment and feedback to students remains largely an open question. To maximize training efficiency, new technologies are required that assist instructors in providing individually relevant instruction. Sandia National Laboratories has shown the feasibility of automated performance assessment tools, such as the Sandia-developed Automated Expert Modeling and Student Evaluation (AEMASE) software, through proof-of-concept demonstrations, a pilot study, and an experiment. In the pilot study, the AEMASE system, which automatically assesses student performance based on observed examples of good and bad performance in a given domain, achieved a high degree of agreement with a human grader (89%) in assessing tactical air engagement scenarios. In more recent work, we found that AEMASE achieved a high degree of agreement with human graders (83-99%) for three Navy E-2 domain-relevant performance metrics. The current study provides a rigorous empirical evaluation of the enhanced training effectiveness achievable with this technology. In particular, we assessed whether giving students feedback based on automated metrics would enhance training effectiveness and improve student performance. We trained two groups of employees (differentiated by type of feedback) on a Navy E-2 simulator and assessed their performance on three domain-specific performance metrics. We found that students given feedback via the AEMASE-based debrief tool performed significantly better than students given only instructor feedback on two out of three metrics. Future work will focus on extending these developments for automated assessment of teamwork.

99 GENERAL AND MISCELLANEOUS↗

Using after-action review based on automated performance assessment to enhance training effectiveness.

Training simulators have become increasingly popular tools for instructing humans on performance in complex environments. However, the question of how to provide individualized and scenario-specific assessment and feedback to students remains largely an open question. In this work, we follow-up on previous evaluations of the Automated Expert Modeling and Automated Student Evaluation (AEMASE) system, which automatically assesses student performance based on observed examples of good and bad performance in a given domain. The current study provides a rigorous empirical evaluation of the enhanced training effectiveness achievable with this technology. In particular, we found that students given feedback via the AEMASE-based debrief tool performed significantly better than students given only instructor feedback on two out of three domain-specific performance metrics.

99 GENERAL AND MISCELLANEOUS↗

Effect of antiferromagnetic layer thickness on exchange bias, training effect, and magnetotransport properties in ferromagnetic/antiferromagnetic antidot arrays

The effect of antiferromagnetic (AFM) layer on exchange bias (EB), training effect, and magnetotransport properties in ferromagnetic (FM) /AFM nanoscale antidot arrays and sheet films Ag(10 nm)/Co(8 nm)/NiO(t{sub NiO})/Ag(5 nm) at 10 K is studied. The AFM layer thickness dependence of the EB field shows a peak at t{sub NiO} = 2 nm that is explained by using the random field model. The misalignment of magnetic moments in the three-dimensional antidot arrays causes smaller decrease of EB field compared with that in the sheet films for training effect. The anomalous magnetotransport properties, in particular positive magnetoresistance (MR) for antidot arrays but negative MR for sheet films are found. The training effect and magnetotransport properties are strongly affected by the three-dimensional spin-alignment effects in the antidot arrays.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Effects of Field of View and Visual Complexity on Virtual Reality Training Effectiveness for a Visual Scanning Task

Virtual reality training systems are commonly used in a variety of domains, and it is important to understand how the realism of a training simulation influences training effectiveness. The paper presents a framework for evaluating the effects of virtual reality fidelity based on an analysis of a simulation’s display, interaction, and scenario components. Following this framework, we conducted a controlled experiment to test the effects of fidelity on training effectiveness for a visual scanning task. The experiment varied the levels of field of view and visual realism during a training phase and then evaluated scanning performance with the simulator’s highest level of fidelity. To assess scanning performance, we measured target detection and adherence to a prescribed strategy. The results show that both field of view and visual realism significantly affected target detection during training; higher field of view led to better performance and higher visual realism worsened performance. Additionally, the level of visual realism during training significantly affected learning of the prescribed visual scanning strategy, providing evidence that high visual realism was important for learning the technique. The results also demonstrate that task performance during training was not always a sufficient measure of mastery of an instructed technique. That is, if learning a prescribed strategy or skill is the goal of a training exercise, performance in a simulation may not be an appropriate indicator of effectiveness outside of training—evaluation in a more realistic setting may be necessary.

97 MATHEMATICS AND COMPUTING↗

Enhanced training effectiveness using automated student assessment.

Training simulators have become increasingly popular tools for instructing humans on performance in complex environments. However, the question of how to provide individualized and scenario-specific assessment and feedback to students remains largely an open question. In this work, we follow-up on previous evaluations of the Automated Expert Modeling and Automated Student Evaluation (AEMASE) system, which automatically assesses student performance based on observed examples of good and bad performance in a given domain. The current study provides an empirical evaluation of the enhanced training effectiveness achievable with this technology. In particular, we found that students given feedback via the AEMASE-based debrief tool performed significantly better than students given only instructor feedback.

99 GENERAL AND MISCELLANEOUS↗

Industrial Energy Assessment Training Effectiveness Evaluation: An Eye-Tracking Study

It is essential to understand the effectiveness of any training program so it can be improved accordingly. Various studies have applied standard metrics for the evaluation of visual behavior to recognize the areas of interest that attract individuals’ attention as there is a high correlation between attentional behavior and where one is focusing on. However, through reviewing the literature, we believe that studies that applied eye-tracking technologies for training purposes are still limited, especially in the industrial energy assessment training field. In this paper, the effectiveness of industrial energy assessment training was quantitatively evaluated by measuring the attentional allocation of trainees using eye-tracking technology. Moreover, this study identifies the areas that require more focus based on evaluating the performance of subjects after receiving the training. Additionally, this research was conducted in a controlled environment to remove the distractions that may be caused by environmental factors to only concentrate on variables that influence the learning behavior of subjects. The experiment results showed that after receiving the training, the subjects’ performance in energy assessment was significantly improved in two areas: production, and recycling and waste management, and the designed training program enhanced the knowledge of participants in identifying energy-saving opportunities to the knowledge level of experienced participants.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Exchange Bias Training Effect in GdBaCo{sub 2}O{sub 5.5} Cobaltite

The nature of the training effect in exchange bias compounds, which consists in a decrease in the exchange bias field H{sub EB} under magnetic field cycling, is clarified. It is shown that the training effect in GdBaCo{sub 2}O{sub 5 + δ} cobaltite with δ ≈ 0.5 is caused by a decrease in magnetization. Depending on time, magnetization M(t) decreases sharply after the first cycle and slowly in subsequent N cycles. A direct relationship (proportionality) is established between the decrease in the magnetization M(t) of ferromagnetic particles and the change of the field H{sub EB}(t). It is assumed that the cooling of a sample in a magnetic field gives rise to small (single-domain) and large ferromagnetic clusters in an antiferromagnetic environment. The sharp decrease in M(t) and H{sub EB}(t) and the deviation of the function H{sub EB}(N) from the well-known power-law relation ΔH{sub EB} ∝ N{sup –1/2} with N > 1 is explained by the transformation of large ferromagnetic clusters into a multidomain state under magnetic field cycling. The results are consistent with the phenomenological model of Meiklejohn and Bean, which predicts a linear dependence of the exchange bias on the ferromagnetic magnetization of a ferromagnet/antiferromagnet structure.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Temperature dependent exchange bias training effect in single-crystalline BiFeO{sub 3}/Co bilayers

Single-crystalline BiFeO{sub 3} (BFO)/Co bilayers were prepared by combined pulsed laser deposition and magnetron sputtering on (001) SrTiO{sub 3} substrates. Exchange bias (EB) and accompanying training effect have been studied as a function of temperature (T) between 5 K and 300 K. A non-monotonic exchange field variation with sharp increase below 100 K has been observed. In the meanwhile, strong training effect was recorded when T < 100 K and it weakens monotonically with increasing T up to 300 K. These temperature dependent EB and training effect may be caused by the uncompensated spins in both the interfacial spin-glass (SG) phase at low temperature and the antiferromagnetic BFO layer at higher temperature. The low temperature EB training results can be well fitted by a modified Binek's model considering asymmetric changes of the pinning SG spins at the descending and the ascending branches.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

A separation of antiferromagnetic spin motion modes in the training effect of exchange biased Co/CoO film with in-plane anisotropy

The motion of antiferromagnetic interfacial spins is investigated through the temperature evolution of training effect in a Co/CoO film with in-plane biaxial anisotropy. Significant differences in the training effect and its temperature dependence are observed in the magnetic easy axis and hard axis (HA) and ascribed to the different motion modes of antiferromagnetic interfacial spins, the collective spin cluster rotation (CSR) and the single spin reversal (SSR), caused by different magnetization reversal modes of ferromagnetic layer. These motion modes of antiferromagnetic spins are successfully separated using a combination of an exponential function and a classic n{sup −1/2} function. A larger CSR to SSR ratio and a shorter lifetime of CSR found in the HA indicates that the domain rotation in the ferromagnetic layer tends to activate and accelerate a CSR mode in the antiferromagnetic spins.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Enhancement of exchange bias and training effect in ion-beam sputtered Fe{sub 46}Mn{sub 54}/Ni{sub 81}Fe{sub 19} bilayers

We present a remarkable enhancement by 300% of the exchange-bias field at room temperature, without affecting the coercivity value, via optimum magnetic annealing (250 °C/3 kOe) in ion-beam sputtered FeMn(30 nm)/NiFe(10 nm) bilayers. This specific behavior has been attributed to a higher degree of γ-FeMn(111) orientation that offers more interfacial FeMn moments to get pinned with the moments of the adjacent NiFe layer. Unlike the absence of training effect at room temperature, a pronounced training effect and an accompanying magnetization reversal asymmetry are evidenced upon field cooling below 50 K due to the presence of biaxial exchange induced anisotropy across the interdiffused FeMn/NiFe interface. The present findings not only have technological significance but also are of relevance to the understanding of interfacial spin disorder and frustration in these exchange-biased systems.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Evaluating the Impact of Head Rotation Amplification on Virtual Reality Training Effectiveness

Virtual reality (VR) systems have been proposed for use in numerous training scenarios, such as room clearing, which require the trainee to maintain spatial awareness. But many VR training systems lack a fully surrounding display, requiring trainees to use a combination of physical and virtual turns to view the environment, thus decreasing spatial awareness. One solution to this problem is to amplify head rotations, such that smaller physical turns are mapped to larger virtual turns, allowing trainees to view the surrounding environment with head movements alone. For example, in a multi-monitor system covering only a 90-degree field of regard, head rotations could be amplified four times to allow the user to see the entire 360-degree surrounding environment. This solution is attractive because it can be used with lower-cost VR systems and does not require virtual turning. However, the effects of amplified head rotations on spatial awareness and training transfer are not well understood. We hypothesized that small amounts of amplification might be tolerable, but that larger amplifications might cause trainees to become disoriented and to have decreased task performance and training transfer. In this paper, we will present our findings from an experiment designed to investigate these hypotheses. The experiment placed users in a virtual warehouse and asked them to move from room to room, counting objects placed around them in space. We varied the amount of amplification applied during these trials, and also varied the type of display used (head-mounted display or CAVE). We measured task performance and spatial awareness. We then assessed training transfer in an assessment environment with a fully surrounding display and no amplification. The results of this study will inform VR training system developers about the potential negative effects of using head rotation amplification and contribute to more effective VR training system design.

3D interaction↗

How Good is Good Enough?: Quantifying the Effects of Training Set Quality

There is a general consensus in the neural network community that noise in training data has a negative impact on model output; however, efforts to quantify the impact of varying levels have been limited, particularly for semantic segmentation tasks. This is a question of particular importance for remote sensing applications where the cost of producing a large training set can lead to reliance on publicly available data with varying degrees of noise. This work explores the effects of different degrees and types of training label noise on a pre-trained building extraction deep learner. Quantitative and qualitative evaluations of these effects can help inform decisions about trade-offs between the cost of producing training data and the quality of model outputs. We found that, relative to the base model, models trained with small amounts of noise showed little change in precision but achieved considerable increases in recall. Conversely, as noise levels increased, both precision and recall decreased. Precision and recall both lagged behind a model trained with pristine data. These exploratory results indicate the importance of quality control for training and, more broadly, that the relationship between degrees and types of training data noise and model performance is more complex than trade-offs between precision and recall.

Swan, Benjamin↗

Multivariate Testing of Sampling Techniques to Address Class Imbalance in Building Use Type Classification

This study addresses the challenges inherent in building use type classification, particularly focusing on the issue of class imbalance in the training datasets for machine learning classifiers. We comprehensively analyze the efficacy of various class-balancing sampling techniques. Employing Monte Carlo simulations and Bayesian optimization, we evaluated the performance of multiple sampling methods, including Random Oversampling, Random Undersampling, SMOTE, Borderline-SMOTE, and ADASYN, across a dataset encompassing nine southeastern coastal states of the United States. Our findings reveal that simple random over- and undersampling techniques outperform more sophisticated methods. Additionally, we show inherent value in creating an imbalance in training data to effectively train a machine learning classifier for distinguishing between residential and nonresidential buildings. This study provides valuable guidance for future research on building use type classification research and lays essential groundwork for developing attribute-rich building stock datasets.

Adams, Daniel↗

Building Monitoring and Energy Efficiency Training for Small and Mid-Sized Commercial Buildings in Non-Urbanized Areas of Alaska

The goal of this project was to create an effective training that increases understanding, competency and capacity in monitoring critical building data. Mentorship, verification and follow-up ensured participants now have necessary skills to install and maintain building monitoring systems. This training sought to empower building managers and maintenance staff to properly and efficiently operate their buildings for energy savings and increased lifespan of equipment. Through the project, participants’ knowledge of the building was increased through hands-on training using a familiar building environment and eliminating common barriers to effective training through peer-to peer delivery. In successful cases the host organization will save money and resources due to more efficient operation of building equipment already in place.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

PHYSICAL FIDELITY CONSIDERATIONS FOR NRC ADVANCED REACTOR CONTROL ROOM TRAINING SIMULATORS USED FOR INSPECTOR/EXAMINER TRAINING

This paper describes research into the physical fidelity requirements of control room simulators to train U.S. Nuclear Regulatory Commission (NRC) staff for their duties as inspectors and license examiners for next-generation nuclear power plants. The control rooms of these power plants are expected to utilize digital instrumentation and controls to a much greater extent than do current plants. The NRC is assessing training facility needs, particularly for control room simulators, which play a central role in NRC training. Simulator fidelity affects both training effectiveness and cost. Research has shown high simulation fidelity sometimes positively affects transfer to the operational environment but sometimes makes no significant difference or actually impedes learning. The conditions in which these different effects occur are often unclear, especially for regulators (as opposed to operators) about whom research is particularly sparse. This project developed an inventory of the tasks and knowledges, skills, and abilities that NRC regulators need to fulfill job duties and used expert panels to characterize the inventory items by type and level of cognitive/behavioral capability needed, difficulty to perform, importance to safety, frequency of performance, and the importance of simulator training for learning these capabilities. A survey of current NRC staff provides information about the physical fidelity of the simulator on which the student trained to the control room to which the student was assigned and the effect lack of fidelity had on learning and job performance. The study concludes that a high level of physical fidelity is not required for effective training of NRC staff.

man-machine interface↗

Quenching of the Exchange Bias Training in Fe/Cr{sub 2}O{sub 3}/Fe Trilayer

Exchange bias (EB) and its associated training effects are studied in an epitaxial Fe(10 nm)/Cr{sub 2}O{sub 3}(2.7 nm)/Fe(10 nm) trilayer heterostructure grown by molecular beam epitaxy. The EB decreases linearly with increasing temperature from T = 5 K to T = 50 K. It changes sign and becomes positive within 50 K < T < 200 K, finally changing back to regular EB for T<200K up to the highest measured temperature of T = 395 K. Remarkably, the latter is far above the bulk Neel temperature TN = 307 K. EB training effects occur only at 5 K < T < 50 K. We show that this training can be quenched by subjecting the system to DC magnetic field, {mu}{sub 0}H{sub DC} {<=} 7 T. The applied field most likely induces a temperature dependent spin-flop transition. Upon its removal the antiferromagnetic Cr{sub 2}O{sub 3} pinning layer evolves uniformly into its quasi-equilibrium spin configuration thus leading to quasi-equilibrium EB.

36 MATERIALS SCIENCE↗