SEARCH · Search NASA

Results for “higher accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

NASA NTRS2009

NPP Clouds and the Earth's Radiant Energy System (CERES) Predicted Sensor Performance Calibration and Preliminary Data Product Performance

Continuation of the Earth Radiation Budget (ERB) Climate Data Record (CDR) has been identified as critical in the 2007 NRC Decadal Survey, the Global Climate Observing System WCRP report, and in an assessment titled Impacts of NPOESS Nunn-McCurdy Certification on Joint NASA-NOAA Climate Goals. In response, NASA, NOAA and NPOESS agreed in early 2008 to fly the final existing CERES Flight Model (FM-5) on the NPP spacecraft for launch in 2010. Future opportunities for ERB CDR continuity consist of procuring an additional CERES Sensor with modest performance upgrades for flight on the NPOESS C1 spacecraft in 2013, followed by a new CERES follow-on sensor for flight in 2018 on the NPOESS C3 spacecraft. While science goals remain unchanged for the long-term ERB Climate Data Record, it is now understood that the task of achieving these goals is more difficult for two reasons. The first is an increased understanding of the dynamics of the Earth/atmosphere system which demonstrates that rigorous separation of natural variability from anthropogenic change on decadal time scales requires higher accuracy and stability than originally envisioned. Secondly, future implementation scenarios involve less redundancy in flight hardware (1 vs. 2 orbits and operational sensors) resulting in higher risk of loss of continuity and reduced number of independent observations to characterize performance of individual sensors. Although EOS CERES CDR's realize a factor of 2 to 4 improvement in accuracy and stability over previous ERBE CDR's, future sensors will require an additional factor of 2 improvement to answer rigorously the science questions moving forward. Modest investments, defined through the CERES Science Team s 30-year operational history of the EOS CERES sensors, in onboard calibration hardware and pre-flight calibration and test program will ensure meeting these goals while reducing costs in re-processing scientific datasets. The CERES FM-5 pre-flight radiometric characterization program benefited from the 30-year operational experience of the CERES EOS sensors, as well as a stronger emphasis of radiometric characterization in the Statement of Work with the sensor provider. Improvements to the pre-flight program included increased spectral, spatial, and temporal sampling under vacuum conditions as well as additional tests to characterize the primary and transfer standards in the calibration facility. Future work will include collaboration with NIST to further enhance the understanding of the radiometric performance of this equipment prior to flight. The current effort summarizes these improvements to the CERES FM-5 pre-flight sensor characterization program, as well as modifications to inflight calibration procedures and operational tasking. In addition, an estimate of the impacts to the system level accuracy and traceability is presented.

Priestly, Kory↗

DOE OSTI2021

Southwest Pacific tropical cyclone development classification utilizing machine learning and synoptic composites

This study evaluates the ability of machine learning algorithms to classify tropical depressions (TDs) and tropical storms (TSs) in the western region of the southwest Pacific Ocean (SWPO). Decision rules are generated to predict the environment required for a depression to fully develop into a mature storm, and the most influential predictors in the classification decision are ranked. TD and TS are discriminated based on a maximum sustained wind speed threshold (≥17 ms -1 ). Various aerosol, thermodynamic, and dynamic parameters are extracted closest to the initiation point of each non-developing and developing sample. The covariates associated with each labelled sample are used to train a decision tree and random forest model. Results using a testing dataset suggest the random forest approach more accurately distinguishes between non-developing and developing samples. The classification accuracy of the decision tree and random forest are 72% and 91%, respectively. Random forest outperformed the decision tree by providing higher accuracy in test data. The most important variables for binary classification are sea salt aerosol optical depth (AOD), 1,000 mb relative humidity, and sea surface temperature. AOD is a quantitative estimate of the aerosols presents in the air through the extinction of a ray of light as it passes through the atmosphere. Mean composite maps constructed in an unsupervised manner have been created for the most important variables identified by the random forest classifier during TD and TS events to highlight the difference in geophysical and aerosol variables' climatology during the two different classifications. This work will advance the risk management strategies for northeastern Australia and other SWPO basin islands to control their tropical cyclone related losses through prioritizing forecasting variables that are the strongest predictors of the strengthening of tropical depressions into tropical cyclones.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Geochemistry and Multiomics Data Differentiate Streams in Pennsylvania Based on Unconventional Oil and Gas Activity

Unconventional oil and gas (UOG) extraction is increasing exponentially around the world, as new technological advances have provided cost-effective methods to extract hard-to-reach hydrocarbons. While UOG has increased the energy output of some countries, past research indicates potential impacts in nearby stream ecosystems as measured by geochemical and microbial markers. Here, we utilized a robust data set that combines 16S rRNA gene amplicon sequencing (DNA), metatranscriptomics (RNA), geochemistry, and trace element analyses to establish the impact of UOG activity in 21 sites in northern Pennsylvania. These data were also used to design predictive machine learning models to determine the UOG impact on streams. We identified multiple biomarkers of UOG activity and contributors of antimicrobial resistance within the order Burkholderiales. Furthermore, we identified expressed antimicrobial resistance genes, land coverage, geochemistry, and specific microbes as strong predictors of UOG status. Of the predictive models constructed (n = 30), 15 had accuracies higher than expected by chance and area under the curve values above 0.70. The supervised random forest models with the highest accuracy were constructed with 16S rRNA gene profiles, metatranscriptomics active microbial composition, metatranscriptomics active antimicrobial resistance genes, land coverage, and geochemistry (n = 23). The models identified the most important features within those data sets for classifying UOG status. These findings identified specific shifts in gene presence and expression, as well as geochemical measures, that can be used to build robust models to identify impacts of UOG development.

16S rRNA↗

NASA NTRS1996

Cloud identification using genetic algorithms and massively parallel computation

As a Guest Computational Investigator under the NASA administered component of the High Performance Computing and Communication Program, we implemented a massively parallel genetic algorithm on the MasPar SIMD computer. Experiments were conducted using Earth Science data in the domains of meteorology and oceanography. Results obtained in these domains are competitive with, and in most cases better than, similar problems solved using other methods. In the meteorological domain, we chose to identify clouds using AVHRR spectral data. Four cloud speciations were used although most researchers settle for three. Results were remarkedly consistent across all tests (91% accuracy). Refinements of this method may lead to more timely and complete information for Global Circulation Models (GCMS) that are prevalent in weather forecasting and global environment studies. In the oceanographic domain, we chose to identify ocean currents from a spectrometer having similar characteristics to AVHRR. Here the results were mixed (60% to 80% accuracy). Given that one is willing to run the experiment several times (say 10), then it is acceptable to claim the higher accuracy rating. This problem has never been successfully automated. Therefore, these results are encouraging even though less impressive than the cloud experiment. Successful conclusion of an automated ocean current detection system would impact coastal fishing, naval tactics, and the study of micro-climates. Finally we contributed to the basic knowledge of GA (genetic algorithm) behavior in parallel environments. We developed better knowledge of the use of subpopulations in the context of shared breeding pools and the migration of individuals. Rigorous experiments were conducted based on quantifiable performance criteria. While much of the work confirmed current wisdom, for the first time we were able to submit conclusive evidence. The software developed under this grant was placed in the public domain. An extensive user's manual was written and distributed nationwide to scientists whose work might benefit from its availability. Several papers, including two journal articles, were produced.

Buckles, Bill P.↗

NASA NTRS1985

Location of noise sources using a phase-slope method

Two three-element microphone arrays have been used to predict the position of both pure-tone and broadband noise sources in an anechoic chamber under different ground impedance conditions. Source positions are predicted using the slope of phase-frequency plots between array elements. A phase-slope method for quantitatively assessing both the accuracy and precision of estimates of noise source location is introduced and illustrated. When the phase-slope method is used, there is higher accuracy and more precision in estimates of source location with a small ground impedance than with a large ground impedance. As would be expected, ground impedance effects are larger for low elevation angles than for high elevation angles.

Deloach, R.↗

DOE OSTI2022

Region-adaptive, Error-controlled Scientific Data Compression using Multilevel Decomposition

The increase of computer processing speed is significantly outpacing improvements in network and storage bandwidth, leading to the big data challenge in modern science, where scientific applications can quickly generate much more data than that can be transferred and stored. As a result, big scientific data must be reduced by a few orders of magnitude while the accuracy of the reduced data needs to be guaranteed for further scientific explorations. Moreover, scientists are often interested in some specific spatial/temporal regions in their data, where higher accuracy is required. The locations of the regions requiring high accuracy can sometimes be prescribed based on application knowledge, while other times they must be estimated based on general spatial/temporal variation. In this paper, we develop a novel multilevel approach which allows users to impose region-wise compression error bounds. Our method utilizes the byproduct of a multilevel compressor to detect regions where details are rich and we provide the theoretical underpinning for region-wise error control. With spatially varying precision preservation, our approach can achieve significantly higher compression ratios than single-error bounded compression approaches and control errors in the regions of interest.We conduct the evaluations on two climate use cases – one targeting small-scale, node features and the other focusing on long, areal features. For both use cases, the locations of the features were unknown ahead of the compression. By selecting approximately 16% of the data based on multi-scale spatial variations and compressing those regions with smaller error tolerances than the rest, our approach improves the accuracy of post-analysis by approximately 2 × compared to single-error-bounded compression at the same compression ratio. Using the same error bound for the region of interest, our approach can achieve an increase of more than 50% in overall compression ratio.

Gong, Qian↗

NASA NTRS1983

Finite element approximations in transient analysis

Alternative techniques for finite element models for transient analyses are explored, using as an example a pinned-pinned beam. Attention is given to the relationships between desired accuracy and the available computer resources. Stiffness, mass, damping, and loading components approximations are examined with note taken of optimization methods. Generation of regular grid results indicates a linear relationship between the number of elements or degrees of freedom and the number of eigenvalues for a given accuracy. Comparisons of the finite element models in terms of accuracy/element or accuracy/degree of freedom were found to be inaccurate for determining model efficiency. Higher accuracies were available from lumped mass and damping models than assumptions of consistent loading, which was preferred to statically equivalent loading.

Melosh, R. J.↗

NASA NTRS1993

Discreteness noise versus force errors in N-body simulations

A low accuracy in the force calculation per time step of a few percent for each particle pair is sufficient for collisionless N-body simulations. Higher accuracy is made meaningless by the dominant discreteness noise in the form of two-body relaxation, which can be reduced only by increasing the number of particles. Since an N-body simulation is a Monte Carlo procedure in which each particle-particle force is essentially random, i.e., carries an error of about 1000 percent, the only requirement is a systematic averaging-out of these intrinsic errors. We illustrate these assertions with two specific examples in which individual pairwise forces are deliberately allowed to carry significant errors: tree-codes on supercomputers and algorithms on special-purpose machines with low-precision hardware.

Hernquist, Lars↗

DOE OSTI2022

Comparison of three state-of-the-art crystal plasticity based deformation twinning models for magnesium alloys

In magnesium alloys, deformation twinning and its interactions with dislocation slip are responsible for a sigmoidal shape stress–strain behavior and an asymmetrical tension–compression yield strength in magnesium alloys. The sensitivity of twinning to the underlying microstructure renders the crystal plasticity method the most commonly adopted modeling approach for magnesium-twinning. This paper compares three state-of-the-art crystal plasticity-based twinning models from the literature, namely the elastic-viscoplastic self-consistent twinning-detwinning (EVPSC-TDT) model, crystal plasticity finite element model based on enhanced predominate twin reorientation approach (CPFE-ePTR), and the crystal plasticity finite element model based on “discrete twinning” approach (CPFE-DT). A polycrystalline microstructure is simulated with all three methods to compare the resulting stress–strain curves and lattice strains to those from the experimentally measured data. All three methods showed the capability of capturing the experimental results with different levels of accuracy. Additionally, the EVPSC-TDT method avoids solving the finite element matrices and showed the highest computational efficiency. The CPFE-ePTR model shows a higher accuracy in capturing the lattice strain. The CPFE-DT relies on high-resolution finite element mesh and is much slower than the other two methods, but it captured the local deformation concentration and stress reversal phenomena near the twin band, which was not possible with the other two methods. Based on the comparison, guidance for the selection of the appropriate model based on the specific modeling target is provided in this paper.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Understanding the effect of density functional choice and van der Waals treatment on predicting the binding configuration, loading, and stability of amine-grafted metal organic frameworks

Metal organic frameworks (MOFs) are crystalline, three-dimensional structures with high surface areas and tunable porosities. Made from metal nodes connected by organic linkers, the exact properties of a given MOF are determined by node and linker choice. MOFs hold promise for numerous applications, including gas capture and storage. M2(4,4′-dioxidobiphenyl-3,3′-dicarboxylate)—henceforth simply M2(dobpdc), with M = Mg, Mn, Fe, Co, Ni, Cu, or Zn—is regarded as one of the most promising structures for CO2 capture applications. Further modification of the MOF with diamines or tetramines can significantly boost gas species selectivity, a necessity for the ultra-dilute CO2 concentrations in the direct-air capture of CO2. There are countless potential diamines and tetramines, paving the way for a vast number of potential sorbents to be probed for CO2 adsorption properties. The number of amines and their configuration in the MOF pore are key drivers of CO2 adsorption capacity and kinetics, and so a validation of computational prediction of these quantities is required to suitably use computational methods in the discovery and screening of amine-functionalized sorbents. In this work, we study the predictive accuracy of density functional theory and related calculations on amine loading and configuration for one diamine and two tetramines. In particular, we explore the Perdew–Burke–Ernzerhof (PBE) functional and its formulation for solids (PBEsol) with and without the Grimme-D2 and Grimme-D3 pairwise corrections (PBE+D2/3 and PBEsol+D2/3), two revised PBE functionals with the Grimme-D2 and Grimme-D3 pairwise corrections (RPBE+D2/3 and revPBE+D2/3), and the nonlocal van der Waals correlation (vdW-DF2) functional. We also investigate a universal graph deep learning interatomic potential’s (M3GNet) predictive accuracy for loading and configuration. These results allow us to identify a useful screening procedure for configuration prediction that has a coarse component for quick evaluation and a higher accuracy component for detailed analysis. Our general observation is that the neural network-based potential can be used as a high-level and rapid screening tool, whereas PBEsol+D3 gives a completely qualitatively predictive picture across all systems studied, and can thus be used for high accuracy motif predictions. We close by briefly exploring the predictions of relative thermal stability for the different functionals and dispersion corrections.

Chemistry↗

DOE OSTI2024

Mixture-of-Experts for Multi-Domain Defect Identification in Non-Destructive Inspection

Composite materials are widely used in aircraft structures because of their superior mechanical properties. However, their complex failure modes require sophisticated inspection methods to ensure structural integrity. Ultrasonic testing (UT) is a common non-destructive inspection (NDI) technique for aircraft composites that can detect internal and external defects with high resolution and accuracy. Despite their effectiveness, traditional UT methods rely on the manual interpretation of ultrasonic signals, which is time-consuming, labor-intensive, and subjective. Furthermore, processing such large-scale data, particularly across materials of varying thicknesses, significantly increases the computational demands of deep learning model optimization. To overcome these challenges, we propose an efficient sparse mixture-of-experts (MoE) model with a multi-level loss function and introduce four novel training objectives to improve computational efficiency and accuracy in identifying surface defects in composite aircraft materials. Here, we evaluated our approach on material with multiple thicknesses or domains comprising various defects. Our experimental results demonstrate higher accuracy and F1-Score, with only 10% training epochs compared to baseline MoE.

composite materials↗

DOE OSTI2024

NUMERICAL MODELING OF A SOLID OXIDE FUEL CELL FOR USE IN REAL-TIME SIMULATION AND CYBER-PHYSICAL SYSTEMS

Cyber-physical systems provide a mechanism with which to investigate the physical phenomena and behavior of traditionally cost-prohibitive or otherwise fragile equipment. For the National Energy Technology Laboratory (NETL), this approach resulted in the Hybrid Performance (Hyper) facility which features a gas turbine-SOFC hybrid cycle utilizing real turbomachinery and a simulated SOFC stack. This allows for the investigation of combined cycle performance and control strategies, in an exhaustive manner, both without fear of destroying delicate state-of-the-art fuel cells, and with the full accuracy of real-world turbomachinery. Issues arose between the transient response of the SOFC model being limited to a sample time of 80 milliseconds, due to the calculation time of the SOFC model taking on average 40 milliseconds to calculate for a given timestep with spikes in calculation time reaching the 80 millisecond threshold. In order to be able to match the speed of transients from the turbomachinery and likewise better discern transient behavior, it was determined that the SOFC model must be optimized to operate at a sample time of 5 milliseconds. Therefore, it is necessary to optimize the SOFC model in order to decrease the calculation time from around 40 milliseconds, down to at the most 5 milliseconds. To do this, both the electrochemical algorithm and the thermal algorithm used to simulate the physical behavior of the SOFC are investigated to determine where improvements can be made. To this end the rootfinding numerical recipes of the electrochemical algorithm are investigated as the complex electrochemistry requires a highly iterative nested dual convergence loop to resolve the voltage-current relationship, and likewise the temporal discretization of the thermal algorithm is modified for the sake of higher accuracy and stability. Ultimately the new electrochemical algorithm featuring higher order rootfinding schemes proves to be efficient enough to reach the sub 5 millisecond target, signifying an order of magnitude reduction in calculation time, and when coupled with the new temporal discretization similar calculation time characteristics show that a fully implicit, higher order temporal discretization can also successfully be used if desired. Ultimately this result means that the cyber-physical simulation system can operate at higher sample rates, and resolve transient events at significantly higher resolution and fidelity.

Arias, Jesus↗

DOE OSTI2023

A global daily soil moisture dataset derived from Chinese FengYun Microwave Radiation Imager (MWRI)(2010–2019)

Surface soil moisture (SSM) is an important variable in drought monitoring, floods predicting, weather forecasting, etc. and plays a critical role in water and heat exchanges between land and atmosphere. SSM products from L-band observations, such as the Soil Moisture Active Passive (SMAP) Mission, have proven to be optimal global estimations. Although X-band has a lower sensitivity to soil moisture than that of L-band, Chinese FengYun-3 series satellites (FY-3A/B/C/D) have provided sustainable and daily multiple SSM products from X-band since 2008. This research developed a new global SSM product (NNsm-FY) from FY-3B MWRI from 2010 to 2019, transferred high accuracy of SMAP L-band to FY-3B X-band. The NNsm-FY shows good agreement with in-situ observations and SMAP product and has a higher accuracy than that of official FY-3B product. With this new dataset, Chinese FY-3 satellites may play a larger role and provide opportunities of sustainable and longer-term soil moisture data record for hydrological study.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Tree, Shrub, and Grass Classification Using Only RGB Images

In this work, a semantic segmentation-based deep learning method, DeepLabV3+, is applied to classify three vegetation land covers, which are tree, shrub, and grass using only three band color (RGB) images. DeepLabV3+’s detection performance has been studied on low and high resolution datasets that both contain tree, shrub, and grass and some other land cover types. The two datasets are heavily imbalanced where shrub pixels are much fewer than tree and grass pixels. A simple weighting strategy known as median frequency weighting was incorporated into DeepLabV3+ to mitigate the data imbalance issue, which originally used uniform weights. The tree, shrub, grass classification performances are compared when all land cover types are included in the classification and also when classification is limited to the three vegetation classes with both uniform and median frequency weights. Among the three vegetation types, shrub is found to be the most challenging one to classify correctly whereas correct classification accuracy was highest for tree. It is observed that even though the median frequency weighting did not improve the overall accuracy, it resulted in better classification accuracy for the underrepresented classes such as shrub in our case and it also significantly increased the average class accuracy. The classification performance and computation time comparison of DeepLabV3+ with two other pixel-based classification methods on sampled pixels of the three vegetation classes showed that DeepLabV3+ achieves significantly higher accuracy than these methods with a trade-off for longer model training time.

58 GEOSCIENCES↗

DOE OSTI2021

Physically regularized machine learning emulators of aerosol activation

Abstract. The activation of aerosol into cloud droplets is an important step in the formation of clouds and strongly influences the radiative budget of the Earth. Explicitly simulating aerosol activation in Earth system models is challenging due to the computational complexity required to resolve the necessary chemical and physical processes and their interactions. As such, various parameterizations have been developed to approximate these details at reduced computational cost and accuracy. Here, we explore how machine learning emulators can be used to bridge this gap in computational cost and parameterization accuracy. We evaluate a set of emulators of a detailed cloud parcel model using physically regularized machine learning regression techniques. We find that the emulators can reproduce the parcel model at higher accuracy than many existing parameterizations. Furthermore, physical regularization tends to improve emulator accuracy, most significantly when emulating very low activation fractions. This work demonstrates the value of physical constraints in machine learning model development and enables the implementation of improved hybrid physical and machine learning models of aerosol activation into next-generation Earth system models.

58 GEOSCIENCES↗

NASA NTRS2002

Towards Arbitrary Accuracy Inviscid Surface Boundary Conditions

Inviscid nonlinear surface boundary conditions are currently limited to third order accuracy in time for non-moving surfaces and actually reduce to first order in time when the surfaces move. For steady-state calculations it may be possible to achieve higher accuracy in space, but high accuracy in time is required for efficient simulation of multiscale unsteady phenomena. A surprisingly simple technique is shown here that can be used to correct the normal pressure derivatives of the flow at a surface on a Cartesian grid so that arbitrarily high order time accuracy is achieved in idealized cases. This work demonstrates that nonlinear high order time accuracy at a solid surface is possible and desirable, but it also shows that the current practice of only correcting the pressure is inadequate.

Dyson, Rodger W.↗

DOE OSTI2022

On the Rapid Calculation of Binding Affinities for Antigen and Antibody Design and Affinity Maturation Simulations

The accurate and efficient calculation of protein-protein binding affinities is an essential component in antibody and antigen design and optimization, and in computer modeling of antibody affinity maturation. Such calculations remain challenging despite advances in computer hardware and algorithms, primarily because proteins are flexible molecules, and thus, require explicit or implicit incorporation of multiple conformational states into the computational procedure. The astronomical size of the amino acid sequence space further compounds the challenge by requiring predictions to be computed within a short time so that many sequence variants can be tested. In this study, we compare three classes of methods for antibody/antigen (Ab/Ag) binding affinity calculations: (i) a method that relies on the physical separation of the Ab/Ag complex in equilibrium molecular dynamics (MD) simulations, (ii) a collection of 18 scoring functions that act on an ensemble of structures created using homology modeling software, and (iii) methods based on the molecular mechanics-generalized Born surface area (MM-GBSA) energy decomposition, in which the individual contributions of the energy terms are scaled to optimize agreement with the experiment. When applied to a set of 49 antibody mutations in two Ab/HIV gp120 complexes, all of the methods are found to have modest accuracy, with the highest Pearson correlations reaching about 0.6. In particular, the most computationally intensive method, i.e., MD simulation, did not outperform several scoring functions. The optimized energy decomposition methods provided marginally higher accuracy, but at the expense of requiring experimental data for parametrization. Within each method class, we examined the effect of the number of independent computational replicates, i.e., modeled structures or reinitialized MD simulations, on the prediction accuracy. We suggest using about ten modeled structures for scoring methods, and about five simulation replicates for MD simulations as a rule of thumb for obtaining reasonable convergence. We anticipate that our study will be a useful resource for practitioners working to incorporate binding affinity calculations within their protein design and optimization process.

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRS2018

Multi-Operator Multi-UAV (MOMU) Control: Exploring the Influence of Sensor Tools and Playbook Task Delegation

New concepts of operations for Unmanned Aerial Vehicles (UAVs) will require a change from the current 2:1 operator to vehicle crew configuration. One particular control paradigm, largely driven by logistics, manpower, and training burdens, as well as the desire to force multiply, involves a single operator simultaneously managing multiple UAVs. This mode of operations has shown to significantly increase cognitive workload and decrease situation awareness, as operators are required to simultaneously attend to multiple sources of information. One potential way to mitigate potential drawbacks of multi-vehicle control by a single operator is to migrate to a multi-operator multi-UAV (MOMU) crew configuration, whereby M operators control N (> M) vehicles. This type of crew configuration can be organized in several ways to dynamically manage cognitive workload, match operator qualifications and skills to mission requirements, increase utilization of available assets, and thereby achieve maximum force multiplication. The present experiment examined task performance in a simulated MOMU environment and evaluated the potential benefits of sensor management aids ("Tools") as well as integrated sensor and flight automation ("Plays") compared to a fully manual condition ("Manual"). Tools support the operator by facilitating rapid understanding and management of sensor information, while the Plays support the operator by offloading/automating subtasks. Six pairs of participants were recruited for this study and tasked with sharing a pool of UAVs in order to conduct reconnaissance, surveillance, and target acquisition (RSTA) missions in adjacent Areas of Operation (AOs). Participants were given four tasks to accomplish, in order of priority: 1) prosecute High Value Targets (HVTs); 2) identify / track targets (military vehicles); 3) identify / mark civilian vehicles; and 4) respond to chat messages. Performance on the mission tasks was measured in terms of accuracy and reaction time. A composite mission score was also calculated using a payoff matrix that weighted each task according to priority. The results indicate that Playbook demonstrated better performance overall with higher accuracy rates and the highest composite score compared to Tools and Manual. The implications of these results to supporting future MOMU concepts of operations is discussed.

Playbook↗