Search NASA⌕ Search

SEARCH · Search NASA

Results for “Autonomy Challenges”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Enabling Autonomous On-Board Trouble-Shooting

As NASA missions reach deeper into space, a few crew members will need to do the work of 10s-100s of Ground Controllers, most significantly, in critical areas such as trouble-shooting anomalies that could result in loss of crew or loss of mission. Understanding what the risk is of these sorts of events based on the history of the International Space Station allows us to anticipate how critical this challenge will be for future crewed missions, and allowing us to define the research that must be carried out in order to establish Standards, Guidelines and Requirements for on-board intelligent technologies that can assist crew as needed.

autonomy↗

Looking to the Future: A Call to Action for Advanced GNC Algorithm Verification and Validation

Future space systems will rely on autonomous Guidance, Navigation, and Control (GNC) functions to efficiently manage safe and precise self-directed operations in uncertain complex environments. Fundamentally, the GNC system plays a key role in mission performance and safety because it computes the ideal trajectory (Guidance), determines the actual trajectory (Navigation), and executes the ideal trajectory (Control) of a vehicle’s position and attitude. Our current GNC systems are highly automated and already have a high degree of complexity. As missions become more ambitious, GNC systems for launch vehicles and space platforms (e.g., spacecraft, probes, and landers) will require higher levels of performance and autonomous operation than previously encountered, for example, this includes GNC for optimizing aerodynamic and/or propulsion performance during planetary entry. This GNC Verification and Validation (V&V) paper highlights concerns with what undoubtedly will be a trend towards increased complexity as fully autonomous GNC systems are developed for future space missions. Clearly, complex GNC systems pose challenges in the prelaunch V&V phase, which is a relatively expensive part of a mission’s life cycle. Essentially the V&V phase is focused on checking that the system effectively meets all the design and operational requirements for the mission. The authors of this paper (i.e., the Inter-Agency Working Group of GNC subject matter experts) focused on this fundamental question over the past few years: Will the GNC engineering community of practice be sufficiently prepared to perform the necessary V&V on evolving GNC architectures that are driven by very demanding requirements for autonomy, resiliency, reconfigurability, adaptability, and mission cost-benefit balance? It is the viewpoint of our Inter-Agency team that the GNC V&V approaches and processes needed to address the next generation of complex GNC systems, which likely will employ various forms of modern GNC technology, are not currently established to the level the community will need in the future. While researchers and practitioners have made some progress in developing new GNC V&V methods for modern GNC systems, a good deal of work remains to be done to codify such methods in a comprehensive and systematic manner. Thus, the Inter-Agency team’s partner organizations [the National Aeronautics and Space Administration (NASA), the European Space Agency (ESA), the National Centre for Space Studies (CNES), the German Aerospace Center (DLR), the French Aerospace Lab (ONERA), and ISAE-SUPAERO] have conducted preliminary investigations into advancing GNC V&V techniques, which resulted in the identification of the need for education, new V&V tools, and benchmark problems for the GNC community. The necessary proactive steps to be taken to meet the challenges and fill the gaps in GNC V&V are summarized in this paper. The first steps include identifying advanced analysis tools, developing a GNC V&V roadmap, and expanding education and training programs for GNC practitioners. This paper is a call to action and proposes a comprehensive set of recommended actions for all our stakeholders: space agencies, researchers, and industry.

Samir Bennani↗

Reliability-Aware Requirements Development for Autonomy Software

Autonomy is the ability of a system to make decisions and take actions in the presence of uncertainty. Validating autonomy, therefore, is a matter of validating that the system makes intelligent decisions even when there might be discrepancies between the observed and the expected state of the world as well as when the possible outcome of each of the possible courses of action is uncertain. During the requirements engineering phase, the functions, including those that are required to be autonomous and their expected behavior are specified. However, in the case of autonomous software system, it is challenging to specify all possible scenarios that the software may encounter. Additionally, since autonomous behaviors cannot always be fully predetermined, it is difficult to reason about their completeness and correctness. While these challenges are also faced with non-autonomous system, they are more prevalent for autonomous system due to their complexity and emergent behavior. Our efforts have been three-fold. On one hand, we have developed a goal-based method for requirements decomposition. We have embedded this approach into a higher-level systems engineering framework and then developed methods for decision and reliability analysis within this framework. And finally, we use simulation analysis to validate the more theoretical methods and provide a feedback mechanism. The decision analysis approach (DA) helps in identifying and mitigating the run-time risks, by bringing to the forefront the uncertainties, decisions, interactions, and other factors that may cause autonomous software to make erroneous decisions. The DA framework is used to quantify, for each decision that the software can make, failure risk due to uncertainties. The information about the key decisions and circumstances that can cause autonomous system to make incorrect decisions are used to generate test scenarios to be run in a simulator to ensure that the system can handle error-prone circumstances. The results or outcomes from decisions, based on the simulated scenarios, can then be leveraged to further gain insight of the assured system. We combine a goal-based approach with simulation analysis to facilitate requirements development for autonomous systems and further provide a method for run-time systems level reliability considerations during the autonomous software development process. The DA and the reliability analysis methods provide a formalism for the consideration of uncertainty in the run time decision-making process for autonomous software. This formalism considers the uncertainty involved in the outcome of different courses of action, in terms of performance and cost, as well as a method to consider the system level reliability implications. System level reliability considerations for autonomous software decision making contribute to the satisfaction of the system level goals over the lifecycle of a given mission. We demonstrate our approach using a hypothetical rover path planning example. The requirements for our rover simulator are based on existing literature about Mars rovers and lessons learned from real world observations at JPL. The specifics of the autonomy design for the Mars rovers, that have not been previously cleared for external release, are not used for our demonstrations.

Lindvall, Mikael↗

Bootstrapping Multi-Agent Unmanned Aerial Vehicle (UAV) System Integration Using Ground-Based Assets: Lessons Learned

The highly dynamic nature of UAVs imposes significant challenges when conducting initial testing ranging from safety risks posed by high-capacity lithium batteries and spinning propellers to rigorous timing demands on controllers and the consequences of failures mid-air. Flight testing of a single vehicle is time and labor intensive due to these challenges and more, and the complexity increases exponentially with the number of vehicles. While simulations and hardware-in-the-loop bench testing can provide adequate environments for preliminary validation, differences in system deployment architecture, software interfaces, and hardware infrastructure between simulation and a fleet of real UAVs create a sizable gap that must be navigated carefully during system integration. In support of the Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) project, which had the goal of establishing a basis of certification of trust and trustworthiness in multi-agent autonomous systems, this gap was tackled from two directions. First, a novel mixed-reality simulation environment was engineered to blur the transition from simulation to flight hardware. Second, a fleet of Unmanned Surface Vehicles (USVs) was developed as a test and evaluation platform that more closely represented the final aerial fleet while eliminating many of the risks associated with air vehicles. This paper delves into the second element, analyzing the efficacy of the USV platform in performing system integration testing for the UAV system. In this paper we present the USV fleet and its role in reducing the aforementioned gaps in deployment architecture, software interfaces, and hardware infrastructure when moving from simulation to flight. An overview of the hardware and software onboard the vehicles will be provided along with supporting infrastructure. The system integration process will be documented including results in supporting both the overarching design reference mission (DRM) of ATTRACTOR and individual research efforts conducted during the project. Finally, we will discuss some of the practical lessons learned regarding the testing, deployment, and operation of multi-agent autonomous systems.

Matthew P Vaughan↗

Airborne Trajectory Management (ABTM): A Blueprint for Greater Autonomy in Air Traffic Management

The aviation users of the National Airspace System (NAS) - the airlines, General Aviation (GA), the military and, most recently, operators of Unmanned Aircraft Systems (UAS) - are constrained in their operations by the design of the current paradigm for air traffic control (ATC). Some of these constraints include ATC preferred routes, departure fix restrictions and airspace ground delay programs. As a result, most flights cannot operate on their most efficient business trajectories and a great many flights are delayed even getting into the air, which imposes a significant challenge to maintaining efficient flight and network operations. Rather than accepting ever more sophisticated scheduling solutions to accommodate the existing constraints in the airspace, a series of increasingly capable airborne technologies, integrated with planned improvements in the ground system through the Federal Aviation Administration (FAA) Next Generation Air Traffic Management System (NextGen) programs, could produce much greater operational flexibility for flight path optimization by the aviation system users. These capabilities, described in research coming out of NASA's Aeronautics Research Mission Directorate, can maintain or improve operational safety while taking advantage of air and ground NextGen technologies in novel ways. The underlying premise is that the nation's physical airspace is still abundant and underused, and that the delays and inefficient flight operations resulting from artificial structure in airspace use and procedural constraints on those operations may not be necessary for safe and efficient flight. This article is not an indictment of today's NAS or the people who run it. Indeed, it is an exceptional achievement that Air Traffic Management (ATM) - the complex human/machine conglomeration of communications, navigation and surveillance equipment and the rules and procedures for controlling traffic in the airspace - has both the capacity and enables the degree of efficiency in air travel that it does. But it is also true that sixty years of the "radar religion" (i.e., reliance on radar-based command and control) has produced several generations of ATM system operators and researchers who believe that introducing automation within the existing functional structure of ATM is the only way to "modernize" the system. Even NextGen, which began as a proposal for "transformational" change in the way ATC is performed, has morphed over the last decade and a half to become just the inclusion of Global Positioning System (GPS) for navigation, Automatic Dependent Surveillance Broadcast (ADS-B) for surveillance, and Data Communications (Data Comm) for communications, while still operating in rigidly structured airspace with human controllers being responsible for separation and traffic flow management (TFM) within defined sectors of airspace, using the same horizontal separation standards that have been in use since raw primary radar was introduced in the 1950s. No system as massive as the current NAS ATM can be replaced with a better system while simultaneously meeting the transportation and other aviation needs of the nation. A new generation of more flexible operations must emerge and yet coexist in harmony with the current operation (i.e., share the same airspace without segregation), thereby enabling a long-term transformation to take place in the way increasing numbers of flights are handled. Market forces will be the ultimate driver of this transformation, and investment realities mandate that real benefits must accrue to the first operators to adopt these new capabilities. In fact, the kinds of missions envisioned in the emerging world of UAS operations, unachievable under conventional ATM, demand that this transformation take place. Airborne Trajectory Management (ABTM) is proposed as a series of transformational steps leading to vastly increased flexibility in flight operations and capacity in the airspace to accommodate many varied airspace uses while improving safety. As will be described, ABTM enables the gradual emergence of a new paradigm for user-based trajectory management in ATM that brings tangible benefits to equipped operators at every step while leveraging the air and ground investments of NextGen. There are five steps in this ABTM transformation.1 NASA has extensively studied the first and last of these steps, and a roadmap of increasing capabilities and benefits is proposed for bridging between these operational concepts.

Cotton, William B.↗

Integrated Planning and Execution for a Self-Reliant Mars Rover

Planetary rovers exploring the surface of Mars face a challenging operational environment that requires close cooperation between deliberative planning and behavioral execution in order to most efficiently leverage the robot’s capabilities into science value returned to earth. The Self-Reliant Rovers project envisions future rover missions that require only occasional high-level direction from human controllers to successfully conduct detailed in-situ studies of its Martian environs. To achieve this high degree of autonomy, this work leverages a spectrum of planning and execution techniques that allow the rover to respond appropriately to both opportunity and adversity it encounters. Small perturbations are accommodated at first by behavioral adaptation, with more and more extensive disruptions handled in turn by executive administration of plan flexibility, heuristic-guided plan repair strategies, and finally comprehensive replanning from science campaign goals. The integrated system has been deployed and tested on a terrestrial rover in an environment and under scenarios that anticipate those faced by future Mars rovers. This paper recounts complexities of planning and execution coordination faced in the rover domain and the practical solutions employed to address them. Particular emphasis is given to lessons from the field and foibles ripe for remedy by future advances in planning and execution research.

Gaines, Daniel↗

Mind the gap: Bridging the divide between AI aspirations and the reality of autonomous microscopy

What does materials science look like in the “Age of Artificial Intelligence?” Each material’s domain—synthesis, characterization, and modeling—has a different answer to this question, motivated by unique challenges and constraints. This work focuses on the tremendous potential of autonomous characterization within electron microscopy. We present our recent advancements in developing domain-aware, multimodal models for microscopy analysis capable of describing complex atomic systems. We then address the critical gap between the theoretical promise of autonomous microscopy and its current practical limitations, showcasing recent successes while highlighting the necessary developments to achieve robust, real-world autonomy.

2D materials↗

Hazard avoidance for a Mars rover

The challenging geology of the surface of Mars, when coupled with the impossibility of continuous remote driving from earth, dictate the need for autonomous hazard detection, recognition and possibly hazard avoidance capabilities onboard any robotic Mars roving vehicle. The main technical issues represented by terrain hazards are accidental damage and vehicle entrapment. Several approaches to vehicle design geared to prevent such immobilization threats are identified. The gamut of alternatives for rover autonomy are also presented, and the applicability of the various options for the Mars Rover/Sample Return mission are assessed in the context of the technology state of the art for hazard sensors and processing algorithms.

Spiessbach, Andrew J.↗

Intelligent Contingency Management for Urban Air Mobility

The third aviation revolution is seeking to enable transportation where users have access to immediate and flexible air travel; the users dictate trip origin, destination and timing. One of the major components of this vision is urban air mobility (UAM) for the masses. UAM means a safe and efficient system for vehicles to move passengers and cargo within a city. In order to reach UAM’s full market potential the vehicle will have to be autonomous. One of the primary challenges of autonomous flight is dealing with off-nominal events, both common and unforeseen; thus, intelligent contingency management (ICM) is one of the enabling technologies. In this context, the vehicle has to be aware of its internal state and external environment at all times, ascertain its capability and make decisions about mission completion or modification. All of these functions require data to model and assess the environment and then take actions based on these models. Necessarily, there is uncertainty associated with the data and the models generated from it. Since we are dealing with safety-critical systems, one of the main challenges of ICM is to generate sufficient data and to minimize its uncertainty to enable practical and safe decision making. We propose an overall architecture that incorporates deterministic and learning algorithms together to assess vehicle capabilities, project these into the future and make decisions on mission management level. A layered approach allows for mature parts and technologies to be integrated into early highly automated vehicles before the final state of autonomy is reached.

data-driven systems↗

Designing a Software Architecture for the Precision Assembly of Space Structures

As NASA’s space exploration and science missions expand in complexity, longevity, anddistance beyond earth’s orbit, Orbital Servicing, Assembly and Manufacturing (OSAM)technologies and concepts have become a critical area of ongoing research and innovation.Artemis’ Moon-to-Mars goals of building sustainable elements on and around the Moon andMars that allow our robots and astronauts to explore and conduct more scientific researchwill demand in situ resource utilization, construction, and maintenance to succeed. In-spaceAssembly (ISA), as a sub-component of OSAM, focuses on the on-orbit building or fabricationof mission infrastructure and payloads. One such ISA application is highlighted by the recentNASA In-Space Assembled Telescope (iSAT) study, which stated that the next generation ofspace observatories will exceed the fairing size of existing or even planned launch vehicles andISA has emerged as a viable approach for observatory assembly. Research efforts at NASALangley Research Center have led to the design of a novel TriTruss structural concept for themodular construction of large complex persistent platforms. The TriTruss design and otherdeveloping OSAM technologies enable larger and persistent space missions that would notbe possible with single-launch-sized structures. For example, 20 meter or larger telescopesor orbital platform applications. However, the increased complexity will require autonomousoperations for the construction and maintenance of long-term infrastructure to achieve missionsuccess. NASA’s Precision Assembly of Space Structures (PASS) project is focused on thestructural and autonomy capabilities required to construct an iSAT in deep space. PASSresearch efforts will develop and validate critical technologies needed for effective efficienton-orbit assembly that can be confidently adopted for future systems. PASS will utilize theTriTruss modules to demonstrate the autonomous modular assembly of a 20m-class iSAT mirrorbackbone structure including simulated mirrors and wiring harness. In this paper, we addressthe software and hardware design considerations, technologies, and challenges of designing arobust robotics framework for assembling modular space structures in support of In SpaceAssembly missions in general as well as for PASS specifically.

Benjamin N Kelley↗

Sky for All: Ushering in a New Era of Aviation

Today’s aviation system will be unable to keep pace with increasing market demand for new operations that capitalize on advancements in autonomy and other emerging technologies. Paradigm shifts are necessary to maintain U.S. leadership in the global aviation market, enhance the sustainability of operations, increase mobility, and provide publicly beneficial services. The Sky for All Vision provides an R&D framework that will support national strategic planning for a holistic airspace ecosystem to usher in a new era of aviation. NASA is in a unique position to tackle the most difficult R&D challenges and to convene the aerospace community towards a common vision.

Jeanne Yu↗

Integrated Systems and Operational Autonomy for Gateway

The Lunar Gateway space station will be operated with less human oversight and control than any human spacecraft thus far. An autonomous software control architecture has been developed to allow the spacecraft to maintain safe operations of the vehicle during times of no human involvement. The development of these autonomous control functionalities has been both technical and process driven. Given that the Gateway will be built modularly with contributions from all over the world, the systems engineering processes had to be shaped to fit with the contractual and political realities of the construction of the international lunar habitat. This paper will describe these challenges and contributions to the development of human spacecraft for sustainable deep space missions.

J M Badger↗

Enabling Autonomous Rover Science through Dynamic Planning and Scheduling

This paper describes how dynamic planning and scheduling techniques can be used onboard a rover to autonomously adjust rover activities in support of science goals. These goals could be identified by scientists on the ground or could be identified by onboard data-analysis software. Several different types of dynamic decisions are described, including the handling of opportunistic science goals identified during rover traverses, preserving high priority science targets when resources, such as power, are unexpectedly over-subscribed, and dynamically adding additional, ground-specified science targets when rover actions are executed more quickly than expected. After describing our specific system approach, we discuss some of the particular challenges we have examined to support autonomous rover decision-making. These include interaction with rover navigation and path-planning software and handling large amounts of uncertainty in state and resource estimations.

planning↗

Assuring Safety-Critical Machine Learning Enabled Systems: Challenges and Promise

Machine learning is increasingly being used in safety-critical systems, where the public safety requires a rigorous assurance process. We shall outline how assurance processes work for conventional systems and identify the primary difficulty in applying them to machine learning enabled systems. We will then outline a path forward including identifying where considerable basic research remains.

machine learning↗

Lunar Base Construction Overview

Previous lunar missions and campaigns have been restricted to using robotic landers and lunar orbiting satellites as well as sortie type of operations using astronaut crews (NASA Apollo program). The next phase of lunar exploration has begun under NASA’s Artemis program and there has been an international response where other nations such as China, Russia, India, Canada, Japan and the European Union of nations, have all expressed interest in either collaborating or competing with NASA on the Moon. This next phase has an over arching goal of achieving a permanent human presence on the Moon via sustainable methods. A lunar base with human occupancy will require infrastructure to provide shelter, utilities, landing/launch pads, roads, communications, power and all the other necessities to sustain human life and protect equipment. Since human biology is not well suited for surviving in the lunar environment, there will be many forms of automated equipment, autonomy and robotic helpers that will minimize the amount of Extra-Vehicular Activity (EVA) required by the crew. This will mean that the radiation dosage received by the crew will stay within acceptable and safe career doses. The required infrastructure must be constructed, but the mass and logistics of bringing all the construction materials from Earth are prohibitive, which makes the necessary construction difficult to achieve. In-Situ Resource Utilization (ISRU) aims to solve this challenge by sourcing construction materials locally or “in-situ”. This means that their transportation can be completely eliminated, resulting in large cost savings by avoiding the launch out of Earth’s deep gravity well and subsequent trans lunar injection, lunar orbit capture and landing. This paper will give an overview of the required construction tasks and related equipment that will be required to robotically build a lunar base using in-situ resources. It will also organize these tasks into logical groupings so that technology development and implementation can be pursued within a framework that can be referenced by all involved.

Construction↗

Usable Translational Hand Controllers for NASA's Habitability Design Center

This summer I was given the opportunity to work at the Habitability Design Center (HDC). NASA Johnson Space Center's HDC is currently developing Cislunar and Mars spacecraft mockups. I contributed to this effort by designing from scratch low cost, functional translational hand controllers (THCs) that will be used in spacecraft mission simulation in low to medium fidelity exploration spacecraft mockups. This project fell under the category of mechatronics, a combination of mechanical, electrical, and computer engineering. Being an aerospace engineering student, I was out of my comfort zone. And that was a wonderful thing. The autonomy that my mentor, Dr. Robert Howard, allowed me gave me the opportunity to learn by trying, failing, and trying again. This project was not only a professional success for me, but a significant learning experience. I appreciated the freedom that I had to take the time to learn new things for myself rather than blindly follow instructions. I was the sole person working on this project, and was required to work independently to solve the many hardware and software challenges that the project entailed. I researched THCs that have been used on the ISS, the Space Shuttle, and the Orion MPVC and based my design off of these. I worked through many redesigns before finding an optimal configuration of the necessary mechanisms and electrical components for the THC. Once I had a functional hardware design, I dove into the challenge of getting an Arduino Uno, an extremely low cost and easily programmable microcontroller, to behave as a human interface device. The THCs I built needed to be able to integrate to a mission simulation designed by NASA's Graphics and Visualization Lab. This proved to be the most challenging aspect of the project. To accomplish this I learned how to change the firmware of the USB serial converter microcontroller. The process was very complicated as it involved multiple software programs and manual flashing of pins on the Arduino itself. When I successfully achieved the goal I wrote an instructions manual for the process so that the HDC will be able to do this easily in the future for any human interface device they may want to create. I also created a detailed CAD model of my THC design with construction instructions. My THC utilizes three ultrasonic sensors, one for each axis of motion. I wrote a code that stimulates these sensors continuously and feeds back values from each axis ranging from -%100 to %100 of the min/max position in relation to the neutral position of each axis. This was the data that the Graphics and Visualization Lab required to interface with their simulation. I truly enjoyed working in the HDC surrounded by passionate, proactive, and brilliantly creative people. I felt valued and respected as a part of their team. I was given the time and support of my mentor whenever I asked for it. Beyond my positive project experience, I was fortunate enough to be able to take advantage of many of the extra activities that JSC has to offer. I took Russian Phase One during my lunch break every day and can now read Russian and accomplish basic verbal communication. I was heavily involved with the co-tern music video, which led to numerous incredible experiences and friendships. I saw every facility, attended every lecture, and met everyone that I could. I had coffee with Lauri Hansen. I played on an intern volleyball team at the Gilruth. I traveled to Michoud, Stennis, NOLA, and Big Bend National Park. I had the time of my life and I fell in love with JSC. In the next month I will return to Maryland and start my senior year of my undergraduate degree. As I work through it I will remember that all of the studying I do, all of the concentration I give, and all of the sacrifices that I make for school are so that I can work at a place like JSC where I am proud and excited to go into work every day. This internship was an invaluable experience for me, both professionally and personally.

Westbrook, Kimberly↗

Development and Field Test Results of Distributed Ground Sensor Fusion Based Object Tracking

Autonomous operations are a crucial aspect in the context of Advanced Air Mobility and other emerging aviation markets. In order to enable this autonomy, an accurate and detailed understanding of the positions of the various vehicles in the air is necessary. Full localization independent of on-board sensors makes the system suitable for noncooperative vehicles. This paper focuses on the object tracking part that relies on distributed ground-based RF and other sensor fusion, considering specific properties and limitations of different sensor types. Results show satisfactory performance in nominal scenarios with full coverage for some sensor types, but RF signals are challenging because of their nature. This paper includes the results from simulations as well as field tests to support the observations and conclusions.

sensor fusion↗