Search NASA⌕ Search

Engineering topics

Trujillo, Anna C.

Publications and source records attributed to Trujillo, Anna C..

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

Evolving Relationship between Humans and Machines

Traditional design typically consists of a master-servant relationship between humans and machines where the human directly controls what the machine will do and when it will do it through an interface. The current archetypical path encompasses moving from informational displays, where the human directly controls the machine based on information displayed, to automation where the human still directs the machine that then caries out the request using predefined set of instructions. Rapid pace of technological advancement makes it possible now, or in a near future, for machines to reach a level of intelligence that enables for systems to execute tasks/missions without predefined specific instructions; thus attaining a status of non- human autonomous agents. Now the course of human-machine interface technology changes from an information system to automation to an autonomous agent—essentially moving from a master-servant relationship to teammates. This paper discusses these changing relationships and challenges associated with progressing from a master-servant relationship with technology to more of an equal teammate. Examples of this progression includes current work encompassing rotorcraft noise minimization for urban air mobility.

Trujillo, Anna C.↗
NASA NTRS2018

Operator Trust Function for Predicted Drone Arrival

To realize the full benefit from autonomy, systems will have to react to unknown events and uncertain dynamic environments. The resulting number of behaviors is essentially infinite; thus, the system is effectively non-deterministic but an operator needs to understand and trust the actions of the autonomous vehicles. This research began to tackle non-deterministic systems and trust by beginning to develop a user trust function based on intent information displayed and the prescribed bounds on allowable behaviors/actions of the non-deterministic system. Linear regression shows promise on being able to predict a person’s confidence of the machine’s prediction. Linear regression techniques indicated that subject characteristics, scenario difficulty, the experience with the system, and confidence earlier in the scenario account for approximately 60% of the variation in confidence ratings. This paper details the specifics of the liner regression model – essentially a trust function – for predicting a person’s confidence.

Trujillo, Anna C.↗
NASA NTRS2018

En Route Detect and Avoid Well Clear in Terminal Area Landing Pattern

A fast time simulation was conducted to test the detect and avoid Well Clear definition designed for en route use when an unmanned aircraft (UA) is approaching the landing pattern of the terminal area. Measures focused on were loss of well clear and alerts intended to help the pilot avoid loss of well clear. Data indicated warning-level alerts will occur outside the typical Class D airspace which may prevent the UA from normal operations in the terminal airspace. Other aircraft on 45o entry could result in “nuisance” alerts which may also prevent the UA from normal operations in the terminal airspace. However, eliminating horizontal proximity (τmod) has the potential to increase “nuisance” alerts on the 45o entry and downwind legs. Overall, this suggests that a more stringent definition of Well Clear may be advisable in the landing pattern of the terminal area.

Trujillo, Anna C.↗
NASA NTRS2016

Using Natural Language to Enable Mission Managers to Control Multiple Heterogeneous UAVs

The availability of highly capable, yet relatively cheap, unmanned aerial vehicles (UAVs) is opening up new areas of use for hobbyists and for commercial activities. This research is developing methods beyond classical control-stick pilot inputs, to allow operators to manage complex missions without in-depth vehicle expertise. These missions may entail several heterogeneous UAVs flying coordinated patterns or flying multiple trajectories deconflicted in time or space to predefined locations. This paper describes the functionality and preliminary usability measures of an interface that allows an operator to define a mission using speech inputs. With a defined and simple vocabulary, operators can input the vast majority of mission parameters using simple, intuitive voice commands. Although the operator interface is simple, it is based upon autonomous algorithms that allow the mission to proceed with minimal input from the operator. This paper also describes these underlying algorithms that allow an operator to manage several UAVs.

Trujillo, Anna C.↗
NASA NTRS2016

Using Natural Language to Enhance Mission Effectiveness

The availability of highly capable, yet relatively cheap, unmanned aerial vehicles (UAVs) is opening up new areas of use for hobbyists and for professional-related activities. The driving function of this research is allowing a non-UAV pilot, an operator, to define and manage a mission. This paper describes the preliminary usability measures of an interface that allows an operator to define the mission using speech to make inputs. An experiment was conducted to begin to enumerate the efficacy and user acceptance of using voice commands to define a multi-UAV mission and to provide high-level vehicle control commands such as "takeoff." The primary independent variable was input type - voice or mouse. The primary dependent variables consisted of the correctness of the mission parameter inputs and the time needed to make all inputs. Other dependent variables included NASA-TLX workload ratings and subjective ratings on a final questionnaire. The experiment required each subject to fill in an online form that contained comparable required information that would be needed for a package dispatcher to deliver packages. For each run, subjects typed in a simple numeric code for the package code. They then defined the initial starting position, the delivery location, and the return location using either pull-down menus or voice input. Voice input was accomplished using CMU Sphinx4-5prealpha for speech recognition. They then inputted the length of the package. These were the option fields. The subject had the system "Calculate Trajectory" and then "Takeoff" once the trajectory was calculated. Later, the subject used "Land" to finish the run. After the voice and mouse input blocked runs, subjects completed a NASA-TLX. At the conclusion of all runs, subjects completed a questionnaire asking them about their experience in inputting the mission parameters, and starting and stopping the mission using mouse and voice input. In general, the usability of voice commands is acceptable. With a relatively well-defined and simple vocabulary, the operator can input the vast majority of the mission parameters using simple, intuitive voice commands. However, voice input may be more applicable to initial mission specification rather than for critical commands such as the need to land immediately due to time and feedback constraints. It would also be convenient to retrieve relevant mission information using voice input. Therefore, further on-going research is looking at using intent from operator utterances to provide the relevant mission information to the operator. The information displayed will be inferred from the operator's utterances just before key phrases are spoken. Linguistic analysis of the context of verbal communication provides insight into the intended meaning of commonly heard phrases such as "What's it doing now?" Analyzing the semantic sphere surrounding these common phrases enables us to predict the operator's intent and supply the operator's desired information to the interface. This paper also describes preliminary investigations into the generation of the semantic space of UAV operation and the success at providing information to the interface based on the operator's utterances.

Trujillo, Anna C.↗
NASA NTRS2015

Operator Informational Needs for Multiple Autonomous Small Vehicles

With the anticipated explosion of small unmanned aerial vehicles, it is highly likely that operators will be controlling fleets of autonomous vehicles. To fulfill the promise of autonomy, vehicle operators will not be concerned with manual control of the vehicle; instead, they will deal with the overall mission. Furthermore, the one operator to many vehicles is becoming a constant meme with various industries including package delivery, search and rescue, and utility companies. In order for an operator to concurrently control several vehicles, his station must look and behave very differently than the current ground control station instantiations. Furthermore, the vehicle will have to be much more autonomous, especially during non-normal operations, in order to accommodate the knowledge deficit or the information overload of the operator in charge of several vehicles. The expected usage increase of small drones requires presenting the operational information generated by a fleet of heterogeneous autonomous agents to an operator. NASA Langley Research Center's Autonomy Incubator has brought together researchers in various disciplines including controls, trajectory planning, systems engineering, and human factors to develop an integrated system to study autonomy issues. The initial human factors effort is focusing on mission displays that would give an operator the overall status of all autonomous agents involved in the current mission. This paper will discuss the specifics of the mission displays for operators controlling several vehicles.

Trujillo, Anna C.↗
NASA NTRS2015

Who's Got the Bridge? - Towards Safe, Robust Autonomous Operations at NASA Langley's Autonomy Incubator

NASA aeronautics research has made decades of contributions to aviation. Both aircraft and air traffic management (ATM) systems in use today contain NASA-developed and NASA sponsored technologies that improve safety and efficiency. Recent innovations in robotics and autonomy for automobiles and unmanned systems point to a future with increased personal mobility and access to transportation, including aviation. Automation and autonomous operations will transform the way we move people and goods. Achieving this mobility will require safe, robust, reliable operations for both the vehicle and the airspace and challenges to this inevitable future are being addressed now in government labs, universities, and industry. These challenges are the focus of NASA Langley Research Center's Autonomy Incubator whose R&D portfolio includes mission planning, trajectory and path planning, object detection and avoidance, object classification, sensor fusion, controls, machine learning, computer vision, human-machine teaming, geo-containment, open architecture design and development, as well as the test and evaluation environment that will be critical to prove system reliability and support certification. Safe autonomous operations will be enabled via onboard sensing and perception systems in both data-rich and data-deprived environments. Applied autonomy will enable safety, efficiency and unprecedented mobility as people and goods take to the skies tomorrow just as we do on the road today.

Allen, B. Danette↗
NASA NTRS2015

Collaborating with Autonomous Agents

With the anticipated increase of small unmanned aircraft systems (sUAS) entering into the National Airspace System, it is highly likely that vehicle operators will be teaming with fleets of small autonomous vehicles. The small vehicles may consist of sUAS, which are 55 pounds or less that typically will y at altitudes 400 feet and below, and small ground vehicles typically operating in buildings or defined small campuses. Typically, the vehicle operators are not concerned with manual control of the vehicle; instead they are concerned with the overall mission. In order for this vision of high-level mission operators working with fleets of vehicles to come to fruition, many human factors related challenges must be investigated and solved. First, the interface between the human operator and the autonomous agent must be at a level that the operator needs and the agents can understand. This paper details the natural language human factors e orts that NASA Langley's Autonomy Incubator is focusing on. In particular these e orts focus on allowing the operator to interact with the system using speech and gestures rather than a mouse and keyboard. With this ability of the system to understand both speech and gestures, operators not familiar with the vehicle dynamics will be able to easily plan, initiate, and change missions using a language familiar to them rather than having to learn and converse in the vehicle's language. This will foster better teaming between the operator and the autonomous agent which will help lower workload, increase situation awareness, and improve performance of the system as a whole.

Trujillo, Anna C.↗
NASA NTRS2015

Towards an Open, Distributed Software Architecture for UxS Operations

To address the growing need to evaluate, test, and certify an ever expanding ecosystem of UxS platforms in preparation of cultural integration, NASA Langley Research Center's Autonomy Incubator (AI) has taken on the challenge of developing a software framework in which UxS platforms developed by third parties can be integrated into a single system which provides evaluation and testing, mission planning and operation, and out-of-the-box autonomy and data fusion capabilities. This software framework, named AEON (Autonomous Entity Operations Network), has two main goals. The first goal is the development of a cross-platform, extensible, onboard software system that provides autonomy at the mission execution and course-planning level, a highly configurable data fusion framework sensitive to the platform's available sensor hardware, and plug-and-play compatibility with a wide array of computer systems, sensors, software, and controls hardware. The second goal is the development of a ground control system that acts as a test-bed for integration of the proposed heterogeneous fleet, and allows for complex mission planning, tracking, and debugging capabilities. The ground control system should also be highly extensible and allow plug-and-play interoperability with third party software systems. In order to achieve these goals, this paper proposes an open, distributed software architecture which utilizes at its core the Data Distribution Service (DDS) standards, established by the Object Management Group (OMG), for inter-process communication and data flow. The design decisions proposed herein leverage the advantages of existing robotics software architectures and the DDS standards to develop software that is scalable, high-performance, fault tolerant, modular, and readily interoperable with external platforms and software.

Cross, Charles D.↗
NASA NTRS2015

Small Unmanned Aircraft Systems Integration into the National Airspace System Visual-Line-of-Sight Human-in-the-Loop Experiment

As part of the Unmanned Aircraft Systems (UAS) in the National Airspace System (NAS) project, research on integrating small UAS (sUAS) into the NAS was underway by a human-systems integration (HSI) team at the NASA Langley Research Center. Minimal to no research has been conducted on the safe, effective, and efficient manner in which to integrate these aircraft into the NAS. sUAS are defined as aircraft weighing 55 pounds or less. The objective of this human system integration team was to build a UAS Ground Control Station (GCS) and to develop a research test-bed and database that provides data, proof of concept, and human factors guidelines for GCS operations in the NAS. The objectives of this experiment were to evaluate the effectiveness and safety of flying sUAS in Class D and Class G airspace utilizing manual control inputs and voice radio communications between the pilot, mission control, and air traffic control. The design of the experiment included three sets of GCS display configurations, in addition to a hand-held control unit. The three different display configurations were VLOS, VLOS + Primary Flight Display (PFD), and VLOS + PFD + Moving Map (Map). Test subject pilots had better situation awareness of their vehicle position, altitude, airspeed, location over the ground, and mission track using the Map display configuration. This configuration allowed the pilots to complete the mission objectives with less workload, at the expense of having better situation awareness of other aircraft. The subjects were better able to see other aircraft when using the VLOS display configuration. However, their mission performance, as well as their ability to aviate and navigate, was reduced compared to runs that included the PFD and Map displays.

Trujillo, Anna C.↗
NASA NTRS2015

Adaptive State Predictor Based Human Operator Modeling on Longitudinal and Lateral Control

Control-theoretic modeling of the human operator dynamic behavior in manual control tasks has a long and rich history. In the last two decades, there has been a renewed interest in modeling the human operator. There has also been significant work on techniques used to identify the pilot model of a given structure. The purpose of this research is to attempt to go beyond pilot identification based on collected experimental data and to develop a predictor of pilot behavior. An experiment was conducted to categorize these interactions of the pilot with an adaptive controller compensating during control surface failures. A general linear in-parameter model structure is used to represent a pilot. Three different estimation methods are explored. A gradient descent estimator (GDE), a least squares estimator with exponential forgetting (LSEEF), and a least squares estimator with bounded gain forgetting (LSEBGF) used the experiment data to predict pilot stick input. Previous results have found that the GDE and LSEEF methods are fairly accurate in predicting longitudinal stick input from commanded pitch. This paper discusses the accuracy of each of the three methods - GDE, LSEEF, and LSEBGF - to predict both pilot longitudinal and lateral stick input from the flight director's commanded pitch and bank attitudes.

Trujillo, Anna C.↗
NASA NTRS2015

Flight Envelope Information-Augmented Display for Enhanced Pilot Situation Awareness

This paper presents an interface system display which is conceived to improve pilot situation awareness with respect to a flight envelope protection system developed for a mid-sized transport aircraft. The new display is designed to complement existing cockpit displays, and to augment them with information that relates to both aircraft state and the control automation itself. In particular, the proposed display provides cues about the state of automation directly in terms of pilot control actions, in addition to flight parameters. The paper also describes a forthcoming evaluation test plan that is intended to validate the developed interface by assessing the relevance of the displayed information, as well as the adequacy of the display layout.

Ackerman, Kasey A.↗
NASA NTRS2014

Adaptive Controller Effects on Pilot Behavior

Adaptive control provides robustness and resilience for highly uncertain, and potentially unpredictable, flight dynamics characteristic. Some of the recent flight experiences of pilot-in-the-loop with an adaptive controller have exhibited unpredicted interactions. In retrospect, this is not surprising once it is realized that there are now two adaptive controllers interacting, the software adaptive control system and the pilot. An experiment was conducted to categorize these interactions on the pilot with an adaptive controller during control surface failures. One of the objectives of this experiment was to determine how the adaptation time of the controller affects pilots. The pitch and roll errors, and stick input increased for increasing adaptation time and during the segment when the adaptive controller was adapting. Not surprisingly, altitude, cross track and angle deviations, and vertical velocity also increase during the failure and then slowly return to pre-failure levels. Subjects may change their behavior even as an adaptive controller is adapting with additional stick inputs. Therefore, the adaptive controller should adapt as fast as possible to minimize flight track errors. This will minimize undesirable interactions between the pilot and the adaptive controller and maintain maneuvering precision.

Trujillo, Anna C.↗
NASA NTRS2014

Wetware, Hardware, or Software Incapacitation: Observational Methods to Determine When Autonomy Should Assume Control

Control-theoretic modeling of human operator's dynamic behavior in manual control tasks has a long, rich history. There has been significant work on techniques used to identify the pilot model of a given structure. This research attempts to go beyond pilot identification based on experimental data to develop a predictor of pilot behavior. Two methods for pre-dicting pilot stick input during changing aircraft dynamics and deducing changes in pilot behavior are presented This approach may also have the capability to detect a change in a subject due to workload, engagement, etc., or the effects of changes in vehicle dynamics on the pilot. With this ability to detect changes in piloting behavior, the possibility now exists to mediate human adverse behaviors, hardware failures, and software anomalies with autono-my that may ameliorate these undesirable effects. However, appropriate timing of when au-tonomy should assume control is dependent on criticality of actions to safety, sensitivity of methods to accurately detect these adverse changes, and effects of changes in levels of auto-mation of the system as a whole.

Trujillo, Anna C.↗
NASA NTRS2014

UAS in the NAS: Survey Responses by ATC, Manned Aircraft Pilots, and UAS Pilots

NASA currently is working with industry and the Federal Aviation Administration (FAA) to establish future requirements for Unmanned Aircraft Systems (UAS) flying in the National Airspace System (NAS). To work these issues NASA has established a multi-center "UAS Integration in the NAS" project. In order to establish Ground Control Station requirements for UAS, the perspective of each of the major players in NAS operations was desired. Three on-line surveys were administered that focused on Air Traffic Controllers (ATC), pilots of manned aircraft, and pilots of UAS. Follow-up telephone interviews were conducted with some survey respondents. The survey questions addressed UAS control, navigation, and communications from the perspective of small and large unmanned aircraft. Questions also addressed issues of UAS equipage, especially with regard to sense and avoid capabilities. From the civilian ATC and military ATC perspectives, of particular interest are how mixed operations (manned / UAS) have worked in the past and the role of aircraft equipage. Knowledge gained from this information is expected to assist the NASA UAS Integration in the NAS project in directing research foci thus assisting the FAA in the development of rules, regulations, and policies related to UAS in the NAS.

Comstock, James R., Jr.↗
NASA NTRS2013

Pilot Preferences on Displayed Aircraft Control Variables

The experiments described here explored how pilots want available maneuver authority information transmitted and how this information affects pilots before and after an aircraft failure. The aircraft dynamic variables relative to flight performance were narrowed to energy management variables. A survey was conducted to determine what these variables should be. Survey results indicated that bank angle, vertical velocity, and airspeed were the preferred variables. Based on this, two displays were designed to inform the pilot of available maneuver envelope expressed as bank angle, vertical velocity, and airspeed. These displays were used in an experiment involving control surface failures. Results indicate the displayed limitations in bank angle, vertical velocity, and airspeed were helpful to the pilots during aircraft surface failures. However, the additional information did lead to a slight increase in workload, a small decrease in perceived aircraft flying qualities, and no effect on aircraft situation awareness.

Trujillo, Anna C.↗
NASA NTRS2013

UAS in the NAS: Survey Responses by ATC, Manned Aircraft Pilots, and UAS Pilots

NASA currently is working with industry and the Federal Aviation Administration (FAA) to establish future requirements for Unmanned Aircraft Systems (UAS) flying in the National Airspace System (NAS). To work these issues NASA has established a multi-center UAS Integration in the NAS project. In order to establish Ground Control Station requirements for UAS, the perspective of each of the major players in NAS operations was desired. Three on-line surveys were administered that focused on Air Traffic Controllers (ATC), pilots of manned aircraft, and pilots of UAS. Follow-up telephone interviews were conducted with some survey respondents. The survey questions addressed UAS control, navigation, and communications from the perspective of small and large unmanned aircraft. Questions also addressed issues of UAS equipage, especially with regard to sense and avoid capabilities. From the ATC and military ATC perspective, of particular interest is how mixed-operations (manned/UAS) have worked in the past and the role of aircraft equipage. Knowledge gained from this information is expected to assist the NASA UAS in the NAS project in directing research foci thus assisting the FAA in the development of rules, regulations, and policies related to UAS in the NAS.

Comstock, James R., Jr.↗