SEARCH · Search NASA

Results for “integrated arrival”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

NASA NTRS2021

ATD-2 Phase 3 Benefits Mechanism

ATD-2 Phase 3↗

NASA NTRS2018

Airspace Technology Demonstration 2 (ATD-2) Technology Description Document (TDD)

This Technology Description Document (TDD) provides an overview of the technology for the Phase 1 Baseline Integrated Arrival, Departure, and Surface (IADS) prototype system of the National Aeronautics and Space Administration's (NASA) Airspace Technology Demonstration 2 (ATD-2) project, to be demonstrated beginning in 2017 at Charlotte Douglas International Airport (CLT). Development, integration, and field demonstration of relevant technologies of the IADS system directly address recommendations made by the Next Generation Air Transportation System (NextGen) Integration Working Group (NIWG) on Surface and Data Sharing and the Surface Collaborative Decision Making (Surface CDM) concept of operations developed jointly by the Federal Aviation Administration (FAA) and aviation industry partners. NASA is developing the IADS traffic management system under the ATD-2 project in coordination with the FAA, flight operators, CLT airport, and the National Air Traffic Controllers Association (NATCA). The primary goal of ATD-2 is to improve the predictability and operational efficiency of the air traffic system in metroplex environments, through the enhancement, development, and integration of the nation's most advanced and sophisticated arrival, departure, and surface prediction, scheduling, and management systems. The ATD-2 project is a 5-year research activity beginning in 2015 and extending through 2020. The Phase 1 Baseline IADS capability resulting from the ATD-2 research will be demonstrated at the CLT airport beginning in 2017. Phase 1 will provide the initial demonstration of the integrated system with strategic and tactical scheduling, tactical departure scheduling to an en route meter point, and an early implementation prototype of a Terminal Flight Data Manager (TFDM) Electronic Flight Data (EFD) system. The strategic surface scheduling element of the capability is consistent with the Surface CDM Concept of Operations published in 2014 by the FAA Surface Operations Directorate.

integrated arrival↗

NASA NTRS2018

Airspace Technology Demonstration 2 (ATD-2) Phase 1 Concept of Use (ConUse)

This document presents an operational Concept of Use (ConUse) for the Phase 1 Baseline Integrated Arrival, Departure, and Surface (IADS) prototype system of NASA's Airspace Technology Demonstration 2 (ATD-2) sub-project, which began demonstration in 2017 at Charlotte Douglas International Airport (CLT). NASA is developing the IADS system under the ATD-2 sub-project in coordination with the Federal Aviation Administration (FAA) and aviation industry partners. The primary goal of ATD-2 sub-project is to improve the predictability and the operational efficiency of the air traffic system in metroplex environments, through the enhancement, development, and integration of the nation's most advanced and sophisticated arrival, departure, and surface prediction, scheduling, and management systems. The ATD-2 effort is a five-year research activity through 2020. The initial phase of the ATD-2 sub-project, which is the focus of this document, will demonstrate the Phase 1 Baseline IADS capability at CLT in 2017. The Phase 1 Baseline IADS capabilities of the ATD-2 sub-project consists of: (a) Strategic and tactical surface scheduling to improve efficiency and predictability of airport surface operations, (b) Tactical departure scheduling to enhance merging of departures into overhead traffic streams via accurate predictions of takeoff times and automated coordination between the Airport Traffic Control Tower (ATCT, or Tower) and the Air Route Traffic Control Center (ARTCC, or Center), (c) Improvements in departure surface demand predictions in Time Based Flow Management (TBFM), (d) A prototype Electronic Flight Data (EFD) system provided by the FAA via the Terminal Flight Data Manager (TFDM) early implementation effort, and (e) Improved situational awareness and demand predictions through integration with the Traffic Flow Management System (TFMS), TBFM, and TFDM (3Ts) for electronic data integration and exchange, and an on-screen dashboard displaying pertinent analytics in real-time. The surface scheduling and metering element of the capability is consistent with the Surface CDM Concept of Operations published in 2014 by the FAA Surface Operations Directorate.1 Upon successful demonstration of the Phase 1 Baseline IADS capability, follow-on demonstrations of the matured IADS traffic management capabilities will be conducted in the 2018-2020 timeframe. At the end of each phase of the demonstrations, NASA will transfer the ATD-2 sub-project technology to the FAA and industry partners.

integrated arrival↗

NASA NTRS2020

ATD-2 Benefits Mechanism

NASA has been developing and demonstrating a suite of decision support capabilities for integrated arrival, departure, and surface (IADS) operations in a metroplex environment. The effort is being made in three phases, under NASA’s Airspace Technology Demonstration 2 (ATD-2) sub-project, through a close partnership with the Federal Aviation Administration (FAA), air carriers, airport, and general aviation community. The Phase 1 Baseline IADS capabilities provide enhanced operational efficiency and predictability of flight operations through data exchange and integration, tactical surface metering, and automated coordination of release time of controlled flights for overhead stream insertion. The Phase 2 Fused IADS capabilities include the fusion of strategic and tactical surface metering, Atlanta Center airspace tactical scheduling, Electronic Flight Data (EFD) integration, Terminal Flight Data Manager (TFDM) Terminal Publication (TTP) prototype, and Mobile App for General Aviation (GA) community. In the Phase 2 field evaluation, strategic surface metering provides advance notice of metering and additional stability to the assigned gate holds. The users of the IADS system in Phases 1 and 2 include the personnel at Charlotte Douglas International Airport (CLT) air traffic control tower, American Airlines ramp tower, CLT terminal radar approach control (TRACON), and Washington and Atlanta Center. This document describes the ATD-2 benefits mechanism used to assess the Phases 1 and 2 IADS capabilities and field evaluation conducted at CLT since September 2017. The ATD-2 benefits mechanism mainly consists of surface metering and overhead stream insertion. This document provides detailed calculation methods of major benefit metrics, such as fuel savings, gas emissions savings, and engine runtime reduction, which can be obtained through surface metering, gate hold of Approval Request (APREQ) flights prior to pushback, and the renegotiation of release time while taxiing. As of March 31, 2020, it is estimated that 5,075,981 pounds of fuel savings and 15,634,022 pounds of CO2 emission reduction have been achieved so far, with a reduction of 3,832 hours in total engine runtime. The amount of CO2 savings is estimated to be equivalent to planting 116,254 urban trees. The pre- and post-metering comparison results using FAA’s Aviation System Performance Metrics (ASPM) data have also shown that the surface metering had no negative impact on the on-time arrival performance of both outbound and inbound flights at CLT.

ATD-2↗

NASA NTRS2020

ATD-2 Benefits Mechanism

NASA has been developing and demonstrating a suite of decision support capabilities for integrated arrival, departure, and surface (IADS) operations in a metroplex environment. The effort is being made in three phases, under NASA’s Airspace Technology Demonstration 2 (ATD-2) sub-project, through a close partnership with the Federal Aviation Administration (FAA), air carriers, airport, and general aviation community. The Phase 1 Baseline IADS capabilities provide enhanced operational efficiency and predictability of flight operations through data exchange and integration, tactical surface metering, and automated coordination of release time of controlled flights for overhead stream insertion. The Phase 2 Fused IADS capabilities include the fusion of strategic and tactical surface metering, Atlanta Center airspace tactical scheduling, Electronic Flight Data (EFD) integration, Terminal Flight Data Manager (TFDM) Terminal Publication (TTP) prototype, and Mobile App for General Aviation (GA) community. In the Phase 2 field evaluation, strategic surface metering provides advance notice of metering and additional stability to the assigned gate holds. The users of the IADS system in Phases 1 and 2 include the personnel at Charlotte Douglas International Airport (CLT) air traffic control tower, American Airlines ramp tower, CLT terminal radar approach control (TRACON), and Washington and Atlanta Center. This document describes the ATD-2 benefits mechanism used to assess the Phases 1 and 2 IADS capabilities and field evaluation conducted at CLT since September 2017. The ATD-2 benefits mechanism mainly consists of surface metering and overhead stream insertion. This document provides detailed calculation methods of major benefit metrics, such as fuel savings, gas emissions savings, and engine runtime reduction, which can be obtained through surface metering, gate hold of Approval Request (APREQ) flights prior to pushback, and the renegotiation of release time while taxiing. As of April 30, 2020, it is estimated that 5,097,173 pounds of fuel savings and 15,699,292 pounds of CO2 emission reduction have been achieved so far, with a reduction of 3,831 hours in total engine runtime. The amount of CO2 savings is estimated to be equivalent to planting 116,739 urban trees. The pre- and post-metering comparison results using FAA’s Aviation System Performance Metrics (ASPM) data have also shown that the surface metering had no negative impact on the on-time arrival performance of both outbound and inbound flights at CLT.

ATD-2↗

NASA NTRS2019

Airspace Technology Demonstration 2 (ATD-2) Phase 2 Technology Description Document (TDD)

This Technology Description Document (TDD) provides an overview of the technology for the Phase 1 Baseline and Phase 2 Fused demonstrations of the Integrated Arrival, Departure, and Surface (IADS) prototype system of the National Aeronautics and Space Administration’s (NASA) Airspace Technology Demonstration 2 (ATD-2) project, which has been demonstrated since October of 2017 at Charlotte Douglas International Airport (CLT). Development, integration, and field demonstration of relevant technologies of the IADS system directly address recommendations made by the Next Generation Air Transportation System (NextGen) Integration Working Group (NIWG) on Surface and Data Sharing and the Surface Collaborative Decision Making (Surface CDM) concept of operations developed jointly by the Federal Aviation Administration (FAA) and aviation industry partners. NASA has been developing the IADS traffic management system under the ATD-2 project in coordination with the FAA, flight operators, CLT airport operators, and the National Air Traffic Controllers Association (NATCA). The primary goal of ATD-2 is to improve the predictability and operational efficiency of the air traffic system in metroplex environments, through the enhancement, development, and integration of the nation’s most advanced and sophisticated arrival, departure, and surface prediction, scheduling, and management systems. The ATD-2 project is a 5-year research activity beginning in 2015 and extending through 2020. The Phase 1 Baseline IADS capability resulting from the ATD-2 research has been demonstrated at the CLT airport since the beginning of October 2017. Phase 1 provided data exchange and integration with the initial demonstration of the integrated system of strategic and tactical scheduling, collaborative tactical surface metering, tactical departure scheduling to an en route meter point and overhead stream insertion, initial integration of a TFDM SWIM prototype feed, and an early implementation prototype of a Terminal Flight Data Manager (TFDM) Electronic Flight Data (EFD) system. The strategic surface scheduling element of the capability is consistent with the Surface CDM Concept of Operations published in 2014 by the FAA Surface Operations Directorate.1 The Phase 2 Fused IADS system provided substantial updates to baseline IADS Demonstration capability. Improvements were made to the IADS modeler; tactical surface scheduling, and metering; tactical departure scheduling for overhead stream insertion; Electronic Flight Data (EFD) and the integration with the FAA Advanced Electronic Flight Strip (AEFS); RTC/RMTC, and departure trajectories. New capabilities included a TFDM SWIM prototype feed and delivery of IADS data via the TFDM Terminal Publication (TTP) service of the FAA’s SWIM system; strategic surface scheduling and metering as well as fusion with tactical surface metering; integration and ingestion of data from TTP-connected Mobile App and texting industry for General Aviation (GA) flights; and expansion of airspace deployments to include adjacent Center automation, in particular interface with the Atlanta Center (ZTL) arrival metering TBFM system to evaluate pre-scheduling of flights. Improvements in Data Analysis and System Health (DASH) monitoring and updates were completed as well.

Talebi, Ehsan↗

NASA NTRS2017

Evaluation of a Tactical Surface Metering Tool for Charlotte Douglas International Airport via Human-in-the-Loop Simulation

NASA has been working with the FAA and aviation industry partners to develop and demonstrate new concepts and technologies that integrate arrival, departure, and surface traffic management capabilities. In March 2017, NASA conducted a human-in-the-loop (HITL) simulation for integrated surface and airspace operations, modeling Charlotte Douglas International Airport, to evaluate the operational procedures and information requirements for the tactical surface metering tool, and data exchange elements between the airline controlled ramp and ATC Tower. In this paper, we focus on the calibration of the tactical surface metering tool using various metrics measured from the HITL simulation results. Key performance metrics include gate hold times from pushback advisories, taxi-in-out times, runway throughput, and departure queue size. Subjective metrics presented in this paper include workload, situational awareness, and acceptability of the metering tool and its calibration.

Verma, Savita↗

NASA NTRS2017

Evaluation of a Tactical Surface Metering Tool for Charlotte Douglas International Airport Via Human-in-the-Loop Simulation

NASA has been working with the FAA and aviation industry partners to develop and demonstrate new concepts and technologies that integrate arrival, departure, and surface traffic management capabilities. In March 2017, NASA conducted a human-in-the-loop (HITL) simulation for integrated surface and airspace operations, modeling Charlotte Douglas International Airport, to evaluate the operational procedures and information requirements for the tactical surface metering tool, and data exchange elements between the airline controlled ramp and ATC Tower. In this paper, we focus on the calibration of the tactical surface metering tool using various metrics measured from the HITL simulation results. Key performance metrics include gate hold times from pushback advisories, taxi-in/out times, runway throughput, and departure queue size. Subjective metrics presented in this paper include workload, situational awareness, and acceptability of the metering tool and its calibration

air traffic management↗

NASA NTRS2018

Tactical Surface Metering Procedures and Information Needs for Charlotte Douglas International Airport

NASA has been working with the FAA and aviation industry partners to develop and demonstrate new concepts and technologies that integrate arrival, departure, and surface traffic management capabilities. In the fall of 2017, NASA began deployment of their technologies in a phased manner to assist with the integrated surface and airspace operations at Charlotte Douglas International Airport (Charlotte, NC). Initial technologies included a tactical surface metering tool and data exchange elements between the airline-controlled ramp and Federal Aviation Administration controlled ATC Tower. In this paper, we focus on the procedures associated with the tactical surface metering tool used in the ramp control tower. This tool was first calibrated in Human-In-the-Loop simulations and was further developed when it was used in the operational world. This paper describes the collaborative procedures that the users exercised in their respective operational worlds to enable surface metering and how several metrics were used to improve the metering algorithm.

Human Factors↗

NASA NTRSDate not supplied

Impact of General Aviation Operations on Airport Performance Through Fast-Time Simulations at Charlotte Douglas International Airport

NASA, in partnership with the Federal Aviation Administration and commercial airlines, deployed the Integrated Arrival, Departure, and Surface (IADS) traffic management system at Charlotte Douglas International Airport (CLT) in 2017 for field evaluation. The system features new capabilities of data exchange and integration, collaborative surface metering and scheduling, which has demonstrated operational benefits of reducing delay time and fuel consumption. General Aviation flights, however, are not currently included in the surface metering programs because of their different operational procedures and lack of reliable predictability in departure time. Thus, their impact on the system performance is not well understood. This paper presents a study of the impact of General Aviation traffic at CLT using fast-time simulations.

General Aviation↗

NASA NTRS2020

Investigating Effects of Controlled Flights through Fast-Time Simulation

Departure flights at major U.S. airports are often subject to Traffic Management Initiatives to mitigate congestion and delay due to demand-capacity imbalances. These controlled flights can lead to inefficiency and delay on the airport surface. The integrated arrival, departure, and surface traffic management capabilities developed by NASA’s Airspace Technology Demonstration 2 (ATD-2) sub-project provide enhanced operational efficiency and predictability of flight operations through data exchange and integration, surface metering, and automated coordination of release time of controlled flights for overhead stream insertion. This paper evaluates the impacts of controlled flights on airport performance and assesses the ATD-2 benefits of pushback hold advisories for both controlled and non-controlled flights using fast-time simulation for Charlotte Douglas International Airport.

controlled flight↗

NASA NTRS2010

Cruise-Efficient Short Takeoff and Landing (CESTOL): Potential Impact on Air Traffic Operations

The National Aeronautics and Space Administration (NASA) is investigating technological and operational concepts for introducing Cruise-Efficient Short Takeoff and Landing (CESTOL) aircraft into a future US National Airspace System (NAS) civil aviation environment. CESTOL is an aircraft design concept for future use to increase capacity and reduce emissions. CESTOL provides very flexible takeoff, climb, descent and landing performance capabilities and a high-speed cruise capability. In support of NASA, this study is a preliminary examination of the potential operational impact of CESTOL on airport and airspace capacity and delay. The study examines operational impacts at a subject site, Newark Liberty Intemational Airport (KEWR), New Jersey. The study extends these KEWR results to estimate potential impacts on NAS-wide network traffic operations due to the introduction of CESTOL at selected major airports. These are the 34 domestic airports identified in the Federal Aviation Administration's Operational Evolution Plan (OEP). The analysis process uses two fast-time simulation tools to separately model local and NAS-wide air traffic operations using predicted flight schedules for a 24-hour study period in 2016. These tools are the Sen sis AvTerminal model and NASA's Airspace Concept Evaluation System (ACES). We use both to simulate conventional-aircraft-only and CESTOL-mixed-with-conventional-aircraft operations. Both tools apply 4-dimension trajectory modeling to simulate individual flight movement. The study applies AvTerminal to model traffic operations and procedures for en route and terminal arrival and departures to and from KEWR. These AvTerminal applications model existing arrival and departure routes and profiles and runway use configurations, with the assumption jet-powered, large-sized civil CESTOL aircraft use a short runway and standard turboprop arrival and departure procedures. With these rules, the conventional jet and CESTOL aircraft are procedurally separated from each other geographically and in altitude during tenninal airspace approach and departure operations, and each use a different arrival runway. AvTeminal implements its unique Focal-point Scheduling Process to sequence, space and delay aircraft to resolve spacing and overtake conflicts among flights in the airspace and airport system serving KEWR. This Process effectively models integrated arrival and departure operations. AvTerminal assesses acceptance rates and delay magnitude and causality at selected locations, including en route outer boundary fixes, tenninal airspace arrival and departure boundary fixes, terminal airspace arrival merge and departure diverge fixes, and runway landing and takeoff runways. The analysis compares the resulting capacity impacts, flight delays and delay sources between CESTOL and conventional KEWR operations. AvTerminal quantitative results showed that CESTOL has significant capability to increase airport arrival acceptance rates (35-40% at KEWR) by taking advantage of otherwise underused airspace and runways where available. The study extrapolates the AvTerminal-derived KEWR peak arrival and departure acceptance rates to estimate capacity parameter values for each of the OEP airports in the ACES modeling of traffic through the entire NAS network. The extrapolations of acceptance rates allow full, partial or no achievement of CESTOL capacity gains at an OEP airport as determined by assessments of the degree to which local procedures allow leveraging of CESTOL capabilities. These assessments consider each OEP airport's runway geometries, runway system configurations, airport and airspace operations, and potential CESTOL traffic loadings. The ACES modeling, simulates airport and airspace spacing constraints imposed by airport runway system, terminal and en route air traffic control and traffic flow management operations using airport acceptance rates representing conventional-aircraft-only and CESTOL-mixed operations. CEOL aircraft are assumed to have Mach 0.8, and alternatively Mach 0.7, cruise speeds to examine compatibility with conventional aircraft operations in common airspace. The ACES results provides estimates of CESTOL delay impact NAS-wide and at OEP airports due to changes in OEP airport acceptance rates and changes in en route airspace potential conflict rates. Preliminary results show meaningful nationwide delay reductions (20%) due to CESTOL operations at 34 major domestic airports.

Couluris, G. J.↗

NASA NTRS2019

Future Surface Decision Support Overview

This presentation presents the capabilities of the Airspace Technology Demonstration 2 (ATD-2) Integrated Arrival, Departure, and Surface (IADS) system as a surface decision support tool for users, including Air Traffic Control (ATC) personnel working at the tower and Center facilities and airline Ramp personnel. The ATD-2 IADS capabilities include data exchange and integration, modeling and scheduling, surface metering, and departure scheduling for overhead stream insertion of constrained flights.

Surface Decision Support↗

NASA NTRS2019

Fast-Time Simulation for Evaluating the Impact of Estimated Flight Ready Time Uncertainty on Surface Metering

NASA has been developing and demonstrating new concepts and technologies for Integrated Arrival, Departure, and Surface (IADS) traffic management capabilities under the Airspace Technology Demonstration 2 (ATD-2) project. One of the IADS capabilities in the ATD-2 project is surface metering enabled by a tactical surface scheduler to provide controllers with the pushback advisories for departures at gates. The tactical surface scheduler uses the estimated flight ready times provided by airlines, called Earliest Off-Block Times (EOBTs), as input to calculate the target off-block times for pushback advisories. However, the EOBTs are often inaccurate and deviate from the actual flight ready times, which may reduce the benefits of surface metering. In this paper, a linear regression model is developed to model the EOBT uncertainty distribution over time based on actual EOBT data collected at Charlotte airport. This EOBT model is integrated with a tactical surface scheduler and a fast-time simulation tool. To evaluate the impact of the EOBT accuracy on airport surface operations, fast-time simulations are implemented for selected traffic scenarios under different levels of modelled EOBT accuracy. The simulation results show that the EOBT uncertainty affects several performance metrics related to the surface metering, such as gate hold, taxi time reduction, and target takeoff time predictability, which in turn influences ATD-2's scheduler performance.

tactical surface scheduler↗

NASA NTRS2019

Fast-Time Simulation for Evaluating the Impact of Estimated Flight Ready Time Uncertainty on Surface Metering

tactical surface scheduler↗

NASA NTRS2017

Assessing Tactical Scheduler Options for Time-Based Surface Metering

NASA is committed to demonstrating a concept of integrated arrival, departure, and surface operations by 2020 under the Airspace Technology Demonstration 2 (ATD2) sub-project. This will be accomplished starting with a demonstration of flight specific time-based departure metering at Charlotte Douglass International Airport (CLT). ATD2 tactical metering capability is based on NASAs Spot And Runway Departure Advisor (SARDA) which has been tested successfully in human-in-the-loop simulations of CLT. SARDA makes use of surface surveillance data and surface modeling to estimate the earliest takeoff time for each flight active on the airport surface or ready for pushback from the gate. The system then schedules each flight to its assigned runway in order of earliest takeoff time and assigns a target pushback time, displayed to ramp controllers as an advisory gate hold time. The objective of this method of departure metering is to move as much delay as possible to the gate to minimize surface congestion and engine on-time, while keeping sufficient pressure on the runway to maintain throughput. This flight specific approached enables greater flight efficiency and predictability, facilitating trajectory-based operations and surface-airspace integration, which ATD2 aims to achieve.Throughout ATD2 project formulation and system development, researchers have continuously engaged with stakeholders and future users, uncovering key system requirements for tactical metering that SARDA did not address. The SARDA scheduler is updated every 10 seconds using real-time surface surveillance data to ensure the most up-to-date information is used to predict runway usage. However, rapid updates also open the potential for fluctuating advisories, which Ramp controllers at a busy airport like CLT find unacceptable. Therefore, ATD2 tactical metering requires that all advisories freeze once flights are ready so that Ramp controllers may communicate a single hold time when responding to pilot ready calls.

Zelinski, Shannon↗

NASA NTRS1993

ROSAT observations of clusters with wide-angle tailed radio sources

The goal of these ROSAT PSPC pointed observations was to understand the nature of X-ray emission associated clusters that contain luminous wide-angle tailed (WAT) radio sources identified with the centrally dominant cluster galaxies. These 500 kpc diameter radio sources are strongly affected by confinement and interaction with the intracluster medium. So, a complete picture of the origin and evolution of these radio sources is not possible without detailed X-ray observations which sample the distribution and temperature of the surrounding hot gas. Two WAT clusters have been observed with the ROSAT PSPC to date. The first is Abell 2634 which contains the WAT 3C 465 and was approved for observations in AO-1. Unfortunately, these observations were broken into two widely separated pieces in time. The first data set containing about 9000 sec of integration arrived in mid-March, 1992. The second data set containing about 10,500 sec arrived just recently in early April (after a first tape was destroyed in the mail). The second cluster is 1919+479 which was approved for observations in AO-2. These ROSAT data arrived in October 1992.

Burns, Jack O.↗

NASA NTRS2013

NextGen Operational Improvements: Will they Improve Human Performance

Modernization of the National Airspace System depends critically on the development of advanced technology, including cutting-edge automation, controller decision-support tools and integrated on-demand information. The Next Generation Air Transportation System national plan envisions air traffic control tower automation that proposes solutions for seven problems: 1) departure metering, 2) taxi routing, 3) taxi and runway scheduling, 4) departure runway assignments, 5) departure flow management, 6) integrated arrival and departure scheduling and 7) runway configuration management. Government, academia and industry are simultaneously pursuing the development of these tools. For each tool, the development process typically begins by assessing its potential benefits, and then progresses to designing preliminary versions of the tool, followed by testing the tool's strengths and weaknesses using computational modeling, human-in-the-loop simulation and/or field tests. We compiled the literature, evaluated the methodological rigor of the studies and served as referee for partisan conclusions that were sometimes overly optimistic. Here we provide the results of this review.

Beard, Bettina L.↗