Search NASA⌕ Search

SEARCH · Search NASA

Results for “onboard autonomy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Reconfigurable Framework for Resilient Semantic Segmentation for Space Applications

Deep learning (DL) presents new opportunities for enabling spacecraft autonomy, onboard analysis, and intelligent applications for space missions. However, DL applications are computationally intensive and often infeasible to deploy on radiation-hardened (rad-hard) processors, which traditionally harness a fraction of the computational capability of their commercial-off-the-shelf counterparts. Commercial FPGAs and system-on-chips present numerous architectural advantages and provide the computation capabilities to enable onboard DL applications; however, these devices are highly susceptible to radiation-induced single-event effects (SEEs) that can degrade the dependability of DL applications. In this article, we propose Reconfigurable ConvNet (RECON), a reconfigurable acceleration framework for dependable, high-performance semantic segmentation for space applications. In RECON, we propose both selective and adaptive approaches to enable efficient SEE mitigation. In our selective approach, control-flow parts are selectively protected by triple-modular redundancy to minimize SEE-induced hangs, and in our adaptive approach, partial reconfiguration is used to adapt the mitigation of dataflow parts in response to a dynamic radiation environment. Combined, both approaches enable RECON to maximize system performability subject to mission availability constraints. We perform fault injection and neutron irradiation to observe the susceptibility of RECON and use dependability modeling to evaluate RECON in various orbital case studies to demonstrate a 1.5–3.0× performability improvement in both performance and energy efficiency compared to static approaches.

97 MATHEMATICS AND COMPUTING↗

Future Vision for Autonomous Ocean Observations

Autonomous platforms already make observations over a wide range of temporal and spatial scales, measuring salinity, temperature, nitrate, pressure, oxygen, biomass; and many other parameters. However, the observations are not comprehensive. Future autonomous systems need to be more affordable, more modular, more capable and easier to operate. Creative new types of platforms and new compact, low power, calibrated and stable sensors are under development to expand autonomous observations. Communications and recharging need bandwidth and power which can be supplied by standardized docking stations. In situ power generation will also extend endurance for many types of autonomous platforms, particularly autonomous surface vehicles. Standardized communications will improve ease of use, interoperability, and enable coordinated behaviors. Improved autonomy and communications will enable adaptive networks of autonomous platforms. Improvements in autonomy will have three aspects: hardware, control, and operations. As sensors and platforms have more onboard processing capability and energy capacity, more measurements become possible. Control systems and software will have the capability to address more complex states and sophisticated reactions to sensor inputs, which allows the platform to handle a wider variety of circumstances without direct operator control. Operational autonomy is increased by reducing operating costs. To maximize the potential of autonomous observations new standards and best practices are needed. In some applications, focus on common platforms and volume purchases could lead to significant cost reductions. Cost reductions could enable order-of-magnitude increases in platform operations and increase sampling resolution for a given level of investment. Energy harvesting technologies should be integral to the system design, for sensors, platforms, vehicles, and docking stations. Connections are needed between the marine energy and ocean observing communities to coordinate among funding sources, researchers, and end users. Regional teams should work with global organizations such as IOC/GOOS in governance development. International networks such as EGO for the emerging glider operations should also provide a forum for addressing governance. Networks of multiple vehicles can improve operational efficiencies and transform operational patterns. There is a need to develop operational architectures at regional and global scales to provide a backbone for active networking of autonomous platforms.

47 OTHER INSTRUMENTATION↗

AI-Enabled Robots for Automated Nondestructive Evaluation and Repair of Power Plant Boilers. Final Report

Boiler failure could cause loss of life and safety issues, cost hundreds of thousands of dollars in equipment repairs, property damage and production losses, and drive up the cost of electric power. Boiler maintenance is challenging and risky for inspectors working on scaffolding in confined hazardous spaces inside of a boiler and sometimes the space is hard to access. The operation is also time-consuming due to the large area of vertical structures for inspection and the tremendous effort needed for scaffolding. Recently, the use of robotics (e.g., drones and crawlers) in power plants for maintenance is growing rapidly. However, the existing robotics solutions show two notable technological gaps: no live repair capability, and no Artificial Intelligence (AI) for smart autonomy. The objective of this project is to develop an integrated autonomous robotic platform that is equipped with compact non-destructive evaluation (NDE) sensors to perform live inspection, operates onboard repair devices to perform live repair, and uses AI for intelligent data fusion and predictive analysis for automated and smart spatiotemporal inspection, analysis and repair of the furnace walls in coal-fired boilers. The approach to achieve the objective includes developing NDE sensors with signal processing techniques, designing and evaluating repair devices for robots based on fusion and solid-state technologies, and an autonomous robotic platform that can attach to and navigate on boiler furnace walls using magnetic drive tracks. The robot is also powered by AI to automate data gathering (e.g., 3D mapping and damage localization) and predictive analysis. This project has advanced the state-of-the-art by providing technological breakthroughs including compact NDE and repair tools for robots, AI capabilities for smart autonomy, and a robotic platform for automated boiler maintenance. This project has great potential to result in significant benefits including limiting or eliminating the need to send operators to assess difficult-to-access or hazardous areas, enabling automated live inspection and repair, avoiding time consuming scaffolding (especially for partial maintenance during unplanned outage), collecting comprehensive and well-organized data smartly, and avoiding or limiting the need for onsite or remote piloting technicians. The impacts can be tremendous in terms of the time and cost savings, reducing the risk for human operators, and increasing boiler reliability, usability, and efficiency. In addition, by developing the new technologies on the autonomous inspection and repair robot, by involving multiple undergraduate and graduate students working together with the faculty members on this project, and by generating knowledge and building up collaborations with industrial partners, this effort will significantly update the education capabilities, support long-term fundamental research, and maintain the leadership of Colorado School of Mines and Michigan State University in energy fields.

20 FOSSIL-FUELED POWER PLANTS↗

Approaches for Synthesis and Deployment of Controller Models on Automated Vehicles for Car-following in Mixed Autonomy

This paper describes the software design patterns and vehicle interfaces that were employed to transition vehicle controllers from simulation environments to open-road field experiments. The approach relies on a life cycle that utilizes model-based design and code generation, along with agile software development, and both software and hardware-in-the-loop testing, with additional safety margins. Autonomous designs should consider the dynamics of mixed autonomy in traffic to safely operate among humans. The software that provides a vehicle’s behavior intelligence is often developed through simulation, which may have a mismatch between dynamics, or as a result of a reinforcement learning workflow, which may be a black box with challenges to analyze. In each of these cases, it is important to have research interfaces that provide strongly typed data streams accessible to researchers who are not software experts while continuing to satisfy safety and liveness constraints. This paper describes how we design the hardware platform interfaces and software design process for a mixed autonomy traffic experiment with a leader-follower scenario. Controller synthesis for these vehicles requires clearly articulated vehicle interfaces and software design patterns for successful onboard deployment. Testing strategies for such controllers are also described before algorithms are transitioned to full-scale field experiments with safety operators for the vehicles. Testing strategies include software-in-the-loop simulation testing, hardware-in-the-loop simulation, ghost-car testing, and read-only testing in live traffic. With our approach, we were not only able to validate our controller synthesized in scripts and simulation, but also able to scale deployment to multiple vehicles.

Bhadani, Rahul↗

Sensing and Sampling of Trace Contaminations by a Dexterous Hexrotor UAV at Nuclear Facilities - 18600

Safe and efficient cleanups are a priority for decontamination and decommissioning of nuclear facilities. The contaminations of byproducts and wastes in such nuclear facilities pose a serious problems while decommissioning, to both the operators and public. Sensing these contaminations and cleaning them is an essential part of the safety procedures. The contaminations might range from low-energy to high-energy byproducts. Sensing these byproducts would require contact based or non-contact based sensing, based on its energy levels. Byproducts such as americium, are low-energy which makes it difficult to sense and sample without contact. Therefore, the workers need to physically swab the surfaces to collect the samples of these contaminations. These tasks pose a great danger for the safety of the human workers which includes the risk to reach greater heights, exposure to the radiation and sampling the entire building. A robotic solution is much more desirable in these cases, where the worker can safely handle the contaminations from a safe area. Use of robotic technologies inside these hazardous environments ensures the safety and enhances the performance. The more suitable robotic solution for reaching great heights and covering large areas of nuclear facilities, are aerial vehicles. Multi-rotor unmanned aerial vehicle (UAV) are chosen for their ability to hover at a position and also fly around in confined spaces. Quadrotors are a common choice of multi-rotor UAVs both research and industry because of its ease to fly and commercial availability. For the applications during the cleanups we need the UAV to not only hover and fly in confined spaces, but also interact with the physical world. Despite of quadrotor's advantages, they are not a best suit as they can't interact with the physical world. The tasks involving physical interactions would require the UAV to apply arbitrary forces and torques in all six degrees of freedom (DOF). As quadrotors are under-actuated and non-holonomic in motion, they cannot exert all the required forces. At Collaborative Robotics Lab, Purdue University, we developed a novel multi-rotor UAV solution, Dexterous Hexrotor, which can exert arbitrary forces and torques in all six DOF, independently and instantaneously. This enables the UAV platform to quickly respond to the external disturbances and precisely hold its position during the mission. The Dexterous Hexrotor serves as a robotic tool for the workers to perform sensing and sampling during the cleanups. Workers can operate Dexterous Hexrotor manually and/or semi-autonomously with human intervention. Manual control requires the worker to fly the Dexterous Hexrotor using a remote control. So the workers should possess knowledge on flying the UAV and to perform physical interaction. A semiautonomous Dexterous Hexrotor requires human input to some extent and requires very less knowledge of flying. The autonomy is designed to operate in flight mode and sampling mode. In flight mode, Dexterous Hexrotor takes off from a 'safe' area, reaches the desired altitude, and fly autonomously towards a sampling point. This sampling point is the target position specified on the 2D reference map. This mode also includes navigation towards the sampling point, avoiding the obstacles in the constrained environment. After reaching a stopping point, Dexterous Hexrotor waits for the human input for a target location to swab and collect samples. The Dexterous Hexrotor is now in sampling mode and waits for the human input. The human operator selects the swabbing location through the live streaming video from onboard camera. Through visual servoing, aided by the map, the UAV will move closer towards the target position. It then transitions to the impact control scheme to perform physical interaction with the wall and collects samples. Once the sample is collected, it autonomously returns back to the takeoff position in 'safe' area for the analysis by mass spectrometry. In this paper, we majorly focus on the physical interaction strategy and the required components which enables the autonomy. Decommissioning of nuclear facilities requires decontamination inside the entire buildings. Decontamination of nuclear facilities involves sensing and sampling the huge buildings, long shafts, etc. Sampling the entire facility is not possible due to the limitation in Dexterous Hexrotor's flight time. But this can be achieved by using a swarm of Dexterous Hexrotors to cover larger areas. The onboard robotic arm can be designed based on the applications such as cleaning, applying sealants, etc. The modularity of the design allows us to switch components as per the requirements of the task. These kind of robotic solutions functioning as tools for the workers, aims to make the work environment safer and playful. (authors)

42 ENGINEERING↗

Autonomy for Hypersonics Mission Campaign (A4H)

A4H is developing autonomous hypersonic flight vehicles that can intelligently navigate, guide, and control themselves and home-in on targets. Autonomous systems are characterized by the use of closed-loop SENSE-THINK-ACT operations to achieve their desired goals. Closing the SENSE-THINK-ACT loop onboard these systems will provide an improved ability to engage diverse targets in contested environments.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Ocean Energy for Ocean Worlds

Energy systems generating power from ocean waves, currents, tides, and thermal and salinity gradients are being developed to power oceanographic instrumentation and autonomous vehicles in Earth’s oceans. Exploration missions enabled or extended with in-situ energy harvesting on Earth may be similar to those on extra-terrestrial ocean worlds including mapping, biogeochemical sampling, acoustic monitoring, search for building blocks of life, and physical oceanographic characterization. With the addition of ocean energy available at the point of observation, data can be collected on larger spatial and temporal scales, enabling more comprehensive missions on other worlds. Power resource characteristics (e.g. current speed, variability) will similarly need to be assessed. Earth and extra-terrestrial ocean missions share vast technical challenges including high expense, need for advanced autonomy, ability to survive in the harshest environments, and limited communications or opportunities for intervention. Marine energy systems may be the only option for in-situ generation in certain scenarios (e.g., under a thick layer of ice) or advantageous over onboard energy storage options that may interfere with the natural environment (e.g., radioisotope thermoelectric generators). This work provides an overview of existing marine energy technology pertaining to ocean observations, highlights emerging research and development and new funding and program initiatives, explores similarities in mission requirements between terrestrial and extra-terrestrial applications, and suggests innovation pathways towards enabling high-value ocean world exploration powered by ocean energy.

Cavagnaro, Robert J.↗

Optimization of Component Sizing for a Fuel Cell-Powered Truck to Minimize Ownership Cost

In this study, we consider fuel cell-powered electric trucks (FCETs) as an alternative to conventional medium- and heavy-duty vehicles. FCETs use a battery combined with onboard hydrogen storage for energy storage. The additional battery provides regenerative braking and better fuel economy, but it will also increase the initial cost of the vehicle. Heavier reliance on stored hydrogen might be cheaper initially, but operational costs will be higher because hydrogen is more expensive than electricity. Achieving the right tradeoff between these power and energy choices is necessary to reduce the ownership cost of the vehicle. This paper develops an optimum component sizing algorithm for FCETs. The truck vehicle model was developed in Autonomie, a platform for modelling vehicle energy consumption and performance. The algorithm optimizes component sizes to minimize overall ownership cost, while ensuring that the FCET matches or exceeds the performance and cargo capacity of a conventional vehicle. Class 4 delivery truck and class 8 linehaul trucks are shown as examples. We estimate the ownership cost for various hydrogen costs, powertrain components, ownership periods, and annual vehicle miles travelled.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

CalTestBed - Delphire - Testing and Evaluation of Delphire Sentinel System (CRADA Final Report)

The Delphire Sentinel is a modular fire detection and communications system operating as a mobile field unit, with low voltage DC power supplied by onboard photovoltaics (PV) and batteries. The Sentinel addresses several aspects of fire detection, communications and data analysis. The Sentinel's mobility enables it to be rapidly deployed and operate independently of existing power and communications networks. The duration of independent operation depends critically on the energy consumption of the systems and performance of the onboard PV and battery. The purpose of this testing is to ascertain the power draw and energy consumption of the Delphire Sentinel prototype system under several operational states, including various data transfer packet sizes, transmission time and frequencies, and communication pathways (Wi-Fi, cellular, satellite) expected to be encountered in field deployments. It will also include procedures to test the ability of the Sentinel to operate for extended periods without loss of functionality. Based on results from energy and power measurements, and anticipated duty cycles in field deployments, we will model annual system autonomy (e.g. loss of load probability) for off-grid operation in representative locations.

47 OTHER INSTRUMENTATION↗

Strym: A Python Package for Real-time CAN Data Logging, Analysis and Visualization to Work with USB-CAN Interface

In this report, we describe a data analysis tool developed for decoding and analyzing vehicle data obtained from a passenger vehicle’s onboard controller area network (CAN) bus. The tool developed in this paper provides a timeseries framework to perform domain-specific analysis at scale when interpreting data from a vehicle or a collection of vehicles in light of how to design intelligent vehicle applications. The tool, called Strym, exploits the CAN bus mechanism of modern vehicles to capture data using commercially available CAN-to-USB hardware Comma.ai Panda devices, managed through open-source software Libpanda. Strym permits the decoding of vendor-specific CAN messages in a vehicle-agnostic manner. Through this, a researcher can characterize data throughput, assess data quality, and perform analyses. Such analyses are useful in a number of research such as studying human driving behavior in mixed-autonomy, new driver models, rare-event detection, traffic flow estimation, and custom control of vehicles.

Performance evaluation, Smart cities, Intelligent ↗

Analysis of the Impact of Radiation on Cameras and Robotic Perception - 19242

Robotic systems are increasingly used for inspection, maintenance, and disaster assistance for nuclear power plants. These robots utilize increasingly high levels of autonomy to operate in environments that are unsafe for humans to operate the robot in or require more precise control over the robot than a human can offer. In these cases, the robot must include perception and computation components to autonomously sense and navigate through the environment to fulfill its mission. This difficult task is complicated by radiation interfering with sensors' operation. The impact of this interference is largely unexplored, as existing works on radiation interference on sensors focus on estimating the incident radiation, rather than how it impacts a robotic system using the sensor. In this work, we seek to quantify and describe the impact of radiation on cameras, and how the radiation affects robotic performance. In this paper we study cameras that are suitable for small, lightweight unmanned aerial vehicles (UAVs) that are increasingly deployed to fly in confined areas in emergencies, where the surrounding environment is unsafe for workers to operate. These small UAVs lack the payload capacity to carry significant radiation shielding, so any onboard sensors will be affected by radiation. In the case of cameras, this radiation appears as noise in the camera imagery. This noise will interfere with the UAV's operation, by obscuring obstacles and interfering with localization and optical flow algorithms that detect detailed features in the environment. To date, there is a lack of information on how the radiation noise in the camera image impacts the overall robot system performance Existing work focuses on estimating the amount of incident radiation by measuring the corruption in the images. However, these works suffer several shortcomings for robotic systems. First, a robot must be able to successfully navigate its environment during a successful mission, and merely quantifying the amount of radiation noise in an image does not adequately explain how it may interfere with higher level navigation and perception tasks. Second, radiation estimation procedures rely on focusing the camera on a known and static background. This is unsuitable for robotic exploration tasks, where the robot frequently moves around an unknown environment that may be dynamically changing. Our work contains two contributions that address these shortcomings. First, we conduct a detailed analysis of the noise radiation causes in cameras by exposing cameras that are commonly used on UAVs [e.g., small form factor complementary metal-oxide-semiconductor (CMOS) cameras] to varying levels of radiation that may be present in emergency scenarios. From this exposure, we quantify not only how much noise is present, but quantify its appearance. By quantifying the appearance and amount of noise in a camera image, researchers can design mitigation strategies for the corruption, so that their robotic systems can operate in these challenging environments. Second, we demonstrate how to leverage this experimental data in robotic simulations. Using data from the first set of experiments allows us to test and verify the robots in simulation. Using simulators allows us to verify the robots will perform as expected during critical times without needing expensive test equipment or damaging valuable robot prototypes. Other researchers using robots for exploration of irradiated environments will benefit from our research by incorporating similar noise models in their research. 1 Southwest Research Institute{sup R} is a registered trademark of Southwest Research Institute in the United States and/or other countries. This will increase the reliability of robotic systems prior to deployment in emergency situations, which will in turn increase their effectiveness and speed the development of robots that would otherwise need expensive and time-consuming test procedures to validate. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗