Enhancing Training Through Extended Reality and Data Fusion
Enhancing Training Through Extended Reality (XR) and Data Fusion will go over XR headsets and software built here at Sandia.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Enhancing Training Through Extended Reality (XR) and Data Fusion will go over XR headsets and software built here at Sandia.
Training simulators have become increasingly popular tools for instructing humans on performance in complex environments. However, the question of how to provide individualized and scenario-specific assessment and feedback to students remains largely an open question. To maximize training efficiency, new technologies are required that assist instructors in providing individually relevant instruction. Sandia National Laboratories has shown the feasibility of automated performance assessment tools, such as the Sandia-developed Automated Expert Modeling and Student Evaluation (AEMASE) software, through proof-of-concept demonstrations, a pilot study, and an experiment. In the pilot study, the AEMASE system, which automatically assesses student performance based on observed examples of good and bad performance in a given domain, achieved a high degree of agreement with a human grader (89%) in assessing tactical air engagement scenarios. In more recent work, we found that AEMASE achieved a high degree of agreement with human graders (83-99%) for three Navy E-2 domain-relevant performance metrics. The current study provides a rigorous empirical evaluation of the enhanced training effectiveness achievable with this technology. In particular, we assessed whether giving students feedback based on automated metrics would enhance training effectiveness and improve student performance. We trained two groups of employees (differentiated by type of feedback) on a Navy E-2 simulator and assessed their performance on three domain-specific performance metrics. We found that students given feedback via the AEMASE-based debrief tool performed significantly better than students given only instructor feedback on two out of three metrics. Future work will focus on extending these developments for automated assessment of teamwork.
This report summarizes research conducted through the Sandia National Laboratories Enhanced Training for Cyber Situational Awareness in Red Versus Blue Team Exercises Laboratory Directed Research and Development project. The objective of this project was to advance scientific understanding concerning how to best structure training for cyber defenders. Two modes of training were considered. The baseline training condition (Tool-Based training) was based on current practices where classroom instruction focuses on the functions of a software tool with various exercises in which students apply those functions. In the second training condition (Narrative-Based training), classroom instruction addressed software functions, but in the context of adversary tactics and techniques. It was hypothesized that students receiving narrative-based training would gain a deeper conceptual understanding of the software tools and this would be reflected in better performance within a red versus blue team exercise.
Training simulators have become increasingly popular tools for instructing humans on performance in complex environments. However, the question of how to provide individualized and scenario-specific assessment and feedback to students remains largely an open question. In this work, we follow-up on previous evaluations of the Automated Expert Modeling and Automated Student Evaluation (AEMASE) system, which automatically assesses student performance based on observed examples of good and bad performance in a given domain. The current study provides an empirical evaluation of the enhanced training effectiveness achievable with this technology. In particular, we found that students given feedback via the AEMASE-based debrief tool performed significantly better than students given only instructor feedback.
Training simulators have become increasingly popular tools for instructing humans on performance in complex environments. However, the question of how to provide individualized and scenario-specific assessment and feedback to students remains largely an open question. In this work, we follow-up on previous evaluations of the Automated Expert Modeling and Automated Student Evaluation (AEMASE) system, which automatically assesses student performance based on observed examples of good and bad performance in a given domain. The current study provides a rigorous empirical evaluation of the enhanced training effectiveness achievable with this technology. In particular, we found that students given feedback via the AEMASE-based debrief tool performed significantly better than students given only instructor feedback on two out of three domain-specific performance metrics.
TRADITIONAL TECHNIQUES OT/IT Concepts Operational Technology (OT) and Information Technology (IT) concepts can often be difficult to visualize Teaching Methods Traditional teaching methods lack the intuitive & immersive aspects of hands-on activities Caveat: Unless taught by Team B! Physical Limitations Digital Twins require existing systems/hardware to mirror UPDATED TECHNIQUES Virtual Environment By making use of a virtual environment, we can represent abstract concepts in a more approachable and digestible way Increased Engagement Students are more engaged with the activities and are more likely to retain the information they are given. New/Emerging Technologies As the system is currently growing and developing, the technologies in use, as well as those represented by the system, stay up-to-date.
Abstract not provided.
We report the demonstration of optical compression of an electron beam and the production of controllable trains of femtosecond, soft x-ray pulses with the Linac Coherent Light Source (LCLS) freeelectron laser (FEL). This is achieved by enhanced self-amplified spontaneous emission with a 2 μm laser and a dechirper device. Optical compression was achieved by modulating the energy of an electron beam with the laser and then compressing with a chicane, resulting in high current spikes on the beam which we observe to lase. A dechirper was then used to selectively control the lasing region of the electron beam. Field autocorrelation measurements indicate a train of pulses, and we find that the number of pulses within the train can be controlled (from 1 to 5 pulses) by varying the dechirper position and undulator taper. These results are a step toward attosecond spectroscopy with x-ray FELs as well as future FEL schemes relying on optical compression of an electron beam.
Enhancing specific heat of Nb3Sn superconductors to improve stability and reduce training
Data from the Princess Sirindhorn Neutron Monitor at Doi Inthanon, Thailand, with a vertical cutoff rigidity of 16.8 GV, were utilized to determine the diurnal anisotropy (DA) of Galactic cosmic rays (GCRs) near Earth during solar minimum conditions between 2007 November and 2010 November. We identified trains of enhanced DA over several days, which often recur after a solar rotation period (∼27 days). By investigating solar coronal holes as identified from synoptic maps and solar wind parameters, we found that the intensity and anisotropy of cosmic rays are associated with the high-speed streams (HSSs) in the solar wind, which are in turn related to the structure and evolution of coronal holes. An enhanced DA was observed after the onset of some, but not all, HSSs. During time periods of recurrent trains, the DA was often enhanced or suppressed according to the sign of the interplanetary magnetic field B, which suggests a contribution from a mechanism involving a southward gradient in the GCR density, n, and a gradient anisotropy along B × ∇n. In one non-recurrent and one recurrent sequence, an HSS from an equatorial coronal hole was merged with that from a trailing mid-latitude extension of a polar coronal hole, and the slanted HSS structure in space with suppressed GCR density can account for the southward GCR gradient. We conclude that the gradient anisotropy is a source of temporary changes in the GCR DA under solar minimum conditions, and that the latitudinal GCR gradient can sometimes be explained by the coronal hole morphology.
Women preferentially mobilize fat stores compared with men in response to sustained, physically demanding military training, as evidenced by increased lipid metabolites and enhanced fat oxidation, which may be beneficial for mitigating loss of lean mass and lower body power.
While a building’s energy usage is driven largely by its design and use, building operator behavior has a strong influence on its energy consumption. This project developed and piloted a specific, data-driven coaching methodology to help operators understand how they can adjust operations and/or affect no/low-cost repairs or upgrades to their specific building HVAC systems to reduce energy consumption. Named BuildingCoach, the operational optimization method used is based on the Building Re-tuning approach developed by the Pacific Northwest National Laboratory. A building operations analytics market has matured over the past decade, though its potential to affect energy-saving changes has not been fully realized. Training operators to understand the methods for operational optimization with the explicit approach of using building-system performance data is hypothesized to create a more effective, longer lasting result in building energy efficiency, and this strategy is the fundamental premise of this project. With the support of an Industry Advisory Board, the project succeeded in developing materials and recruiting for and delivering three pilot cohorts. Deliverables included twenty-two self-paced training modules (accessed via a Learning Management System) and a web-based platform that includes access to real-time building system data and a repository for building system documentation. The project set out to have 100 participants from 50 buildings in three pilot cohorts. In the end, there were 28 participants from 17 buildings, i.e., a significant shortfall. The first two pilot cohorts had only two buildings in each, and this was partially due to difficulties in deploying the Building Operator Coaching Solution (“the BOCS”), which is technology that extracts the data from the controls network and presents it as prescribed for coaching. In the third cohort, the project team deployed the BOCS successfully to 13 buildings, the methodology was piloted as intended, and numerous opportunities for optimization were identified. The BuildingCoach business plan charts a path to an economically sustainable effort. However, even with a licensing model captured in the final version of the business plan, the scalability is still limited to keeping less than 1,000 buildings affected by 2033. Even so, there are unexplored paths to greater scalability that are being considered. CUNY BPL is working to perpetuate and grow the use of BuildingCoach. As of this writing, about twenty buildings have either been connected or will be connected with operators coached / to be coached in the NYC municipal portfolio, twelve buildings across four campuses in NY State will use BuildingCoach, a NY upstate county wishes for six or seven buildings to participate with the support of funding from NYSERDA, and others have also expressed interest. In the decades to come, there will be an increasing percentage of large and mid-sized buildings that incorporate automated system optimization (ASO), and the building operators’ role will shift to spend more time on maintenance and monitoring. Meanwhile, programs such as BuildingCoach will play a critical role in optimizing operations. And, regardless of the emergence of ASO, operators will still need to understand how their systems operate so that they can monitor them properly. Within that context, BuildingCoach is an important step towards operators’ understanding of efficient building system operations.
The Department of Energy Training Institute (DTI) was established in March 2016 to provide training enhancements for the DOE enterprise. Effective training improves worker safety and directly supports the completion of DOE missions. The overall intent of DTI is to reduce redundant training, improve safety, and avoid duplicate course training development and subsequently reduce future training maintenance costs. Implementation of the DTI initiatives of training reciprocity, common core fundamental course materials, instructor certification, and providing training support tools such as the Course and Related Data System (CARDS) has resulted in direct and indirect cost avoidances. (authors)
Mixed reality technology is being used across Idaho National Laboratory (INL) to enhance training and workforce development. Projects involving mixed reality such as lockout/tagout , the Industrial Control System Laboratory , and a Department of Defense microreactor demonstration have benefited from these innovative approaches. Several key concerns exist with integrating this new technology, including ease of use, ease of setup, and maintenance through the lifecycle. These aspects need to be properly addressed to ensure that this technology remains attractive and useful to operations teams as well as engineers and researchers at INL. Primarily, this requires buy-in from information technology management, designing software/hardware-agnostic tools, and reducing friction with technology integration. To be successful, regular operational use of this new and unfamiliar technology will require straightforward user interfaces, simple setup processes, and feature-rich experiences that reduce the time needed to benefit from the technology. INL is improving its toolset to allow for a streamlined deployment and use of mixed reality technologies that are directly available to researchers and engineers.
Background: Artificial intelligence is increasingly utilized to aid in the interpretation of cardiac magnetic resonance (CMR) studies. One of the first steps is the identification of the imaging plane depicted, which can be achieved by both deep learning (DL) and classical machine learning (ML) techniques without user input. We aimed to compare the accuracy of ML and DL for CMR view classification and to identify potential pitfalls during training and testing of the algorithms. Methods: To train our DL and ML algorithms, we first established datasets by retrospectively selecting 200 CMR cases. The models were trained using two different cohorts (passively and actively curated) and applied data augmentation to enhance training. Once trained, the models were validated on an external dataset, consisting of 20 cases acquired at another center. We then compared accuracy metrics and applied class activation mapping (CAM) to visualize DL model performance. Results: The DL and ML models trained with the passively-curated CMR cohort were 99.1% and 99.3% accurate on the validation set, respectively. However, when tested on the CMR cases with complex anatomy, both models performed poorly. After training and testing our models again on all 200 cases (active cohort), validation on the external dataset resulted in 95% and 90% accuracy, respectively. The CAM analysis depicted heat maps that demonstrated the importance of carefully curating the datasets to be used for training. Conclusions: Both DL and ML models can accurately classify CMR images, but DL outperformed ML when classifying images with complex heart anatomy.
A properly trained first responder community is critical to the successful introduction of hydrogen fuel cell applications and their transformation in how we use energy. Providing resources with accurate information and current knowledge is essential to the delivery of effective hydrogen and fuel cell-related first responder training. Furthermore, the California Fuel Cell Partnership and the Pacific Northwest National Laboratory have over 15 years of experience in developing and delivering hydrogen safety-related first responder training materials and programs. A National Hydrogen and Fuel Cell Emergency Response Training Resource was recently released (http://h2tools.org/fr/nt/). This training resource serves the delivery of a variety of training regimens. Associated materials are adaptable for different training formats, ranging from high-level overview presentations to more comprehensive classroom training. Our paper presents what has been learned from the development and delivery of hydrogen safety-related first responder training programs (online, classroom, hands-on) by the respective organizations. We discussed the collaborative strategy being developed for enhancing training materials and methods for greater accessibility based on stakeholder input.