Search NASA⌕ Search

DOE OSTI · 965593

Methodology, Methods, and Metrics for Testing and Evaluating Augmented Cognition Systems

Abstract

The augmented cognition research community seeks cognitive neuroscience-based solutions to improve warfighter performance by applying and managing mitigation strategies to reduce workload and improve the throughput and quality of decisions. The focus of augmented cognition mitigation research is to define, demonstrate, and exploit neuroscience and behavioral measures that support inferences about the warfighter’s cognitive state that prescribe the nature and timing of mitigation. A research challenge is to develop valid evaluation methodologies, metrics and measures to assess the impact of augmented cognition mitigations. Two considerations are external validity, which is the extent to which the results apply to operational contexts; and internal validity, which reflects the reliability of performance measures and the conclusions based on analysis of results. The scientific rigor of the research methodology employed in conducting empirical investigations largely affects the validity of the findings. External validity requirements also compel us to demonstrate operational significance of mitigations. Thus it is important to demonstrate effectiveness of mitigations under specific conditions. This chapter reviews some cognitive science and methodological considerations in designing augmented cognition research studies and associated human performance metrics and analysis methods to assess the impact of augmented cognition mitigations.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Greitzer, Frank L. 2008-09-15. Methodology, Methods, and Metrics for Testing and Evaluating Augmented Cognition Systems. https://searchnasa.com/record/osti%3A965593/methodology-methods-and-metrics-for-testing-and-evaluating-augmented-cognition-systems

Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Search NASA by Indiciae: BibTeX · RIS.

KEEP EXPLORING

Related reports

Morgana Overview – NCERC Support for Dynamic Subcritical Experiments

The LANL Subcritical Experiments Program (SCE) recently executed the Morgana Subcritical Experiment at the NNSS. This was the first subcritical experiment executed by LANL for several years (since 2021). It was also notably the first that required SCE personnel to have FMH qualifications for a portion of the work conducted under nuclear criticality safety limits.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

AWSD Reactive Burn Model for the HMX‐Based High Explosive LX‐04

An Arrhenius–Wescott–Stewart–Davis (AWSD) reactive burn model is applied to describe shock initiation and detonation properties of the HMX-based high explosive LX-04. The parameters in the model are calibrated to data from multiple sources. The thermodynamic equations of state used in the model are calibrated to a combination of thermochemical calculations for HMX and LX-04 as well as experimentally-measured cylinder expansion results for LX-04. The kinetic parameters are calibrated to velocity data from gas gun experiments performed using EDC-32—a high explosive with the same chemical composition as LX-04 but different structural properties, and scaled rate stick data for PBX 9012. The AWSD model is shown to accurately describe the shock initiation and propagation of LX-04. Very good agreement is observed between the available experimental data and the AWSD model output. The presented results constitute an accurate LX-04 reactive burn model for use in engineering-scale models and simulations.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Surface and Buried Thermal, and RGB Unexploded Ordnance Data Collection

This document provides a description of a data collection campaign of unexploded ordnance (UXOI) set. The dataset captures a controlled UAV imaging campaign designed to support detection of UXO across varied environmental conditions. Data were collected during three campaigns in Norris and Northeast Knoxville, Tennessee, using RGB, and thermal sensors mounted on Parrot UKR. In total, the dataset contains 9925 images, 26 full-motion video, and approximately 81.99 GB of data, collected across late spring/summer conditions, every hour during sunlight, and multiple surface contexts, including tall grass, short grass, gravel, as well as buried in sand, and other gravel mixtures. The collection was designed to capture thermal and visual variability relevant to UXO detection in agricultural land, bare earth, and subsurface. Review of the imagery showed that ordnance was most detectable during periods of changing solar input, especially approximately 10-60 minutes after sunrise, approximately 20-60 minutes after sunset, and 2-3 min after cloud cover interrupted prolonged solar heating. These conditions increased thermal contrast because many ordnance items retained or released heat differently than the surrounding vegetation and ground surface. This dataset provides a useful resource for developing and evaluating airborne UXO detection methods under realistic field conditions. All ordnance used in the study was inert, and thermal behavior may differ from that of live ordnance. In addition, variation in ordnance type, composition, and placement introduced differences in thermal response that should be considered when interpreting results.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗