Search NASA⌕ Search

SEARCH · Search NASA

Results for “autonomous robotics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
NASA NTRS2016

Robots for Astrobiology!

The search for life and its study is known as astrobiology. Conducting that search on other planets in our Solar System is a major goal of NASA and other space agencies, and a driving passion of the community of scientists and engineers around the world. We practice for that search in many ways, from exploring and studying extreme environments on Earth, to developing robots to go to other planets and help us look for any possible life that may be there or may have been there in the past. The unique challenges of space exploration make collaborations between robots and humans essential. The products of those collaborations will be novel and driven by the features of wholly new environments. For space and planetary environments that are intolerable for humans or where humans present an unacceptable risk to possible biologically sensitive sites, autonomous robots or telepresence offer excellent choices. The search for life signs on Mars fits within this category, especially in advance of human landed missions there, but also as assistants and tools once humans reach the Red Planet. For planetary destinations where we do not envision humans ever going in person, like bitterly cold icy moons, or ocean worlds with thick ice roofs that essentially make them planetary-sized ice caves, we will rely on robots alone to visit those environments for us and enable us to explore and understand any life that we may find there. Current generation robots are not quite ready for some of the tasks that we need them to do, so there are many opportunities for roboticists of the future to advance novel types of mobility, autonomy, and bio-inspired robotic designs to help us accomplish our astrobiological goals. We see an exciting partnership between robotics and astrobiology continually strengthening as we jointly pursue the quest to find extraterrestrial life.

Robotics↗
NASA NTRS1992

Future needs for space robots for SEI

High level systems engineering modeling and analysis activities for the Space Exploration Initiative (SEI) are reviewed, with emphasis on planet surface systems. Particular attention is given to SEI studies, preliminary space robotic system requirements, and usefulness of space robotic systems developed to operate on planetary surfaces on earth. It is concluded that supervised intelligent systems on the planet surfaces are necessary to make SEI planet surface activities reliable and productive and encompass capabilities for control and monitoring of all elements, including supervised autonomous robotic systems. Amplification of human capabilities due to applying more knowledge and reasoning in more flexible and appropriate ways than conventional automation approaches will provide more robust performance, greater choice of interaction modes with operators, and greater transparency of operation.

Erickson, Jon D.↗
NASA NTRSDate not supplied

Space Transformation -- Localizing the Remote and Connecting the Isolated

In motivating the Space Transformation theme for this year’s 4S symposium, the organizers provided the following context, “Transformation of economies are driven by a change in values and accelerated by new technologies.” These words rang particularly true when I read them at the beginning of the holiday season. Like so many others, I was in the early phases of my Christmas shopping procrastination campaign, and I’d just been reflecting on how Amazon Prime was the transformational tool I’d been waiting for. Basic limiting principles of time and space, supply and demand, were all but erased by the Amazon Prime phenomenon. Coupled with emerging 3D printing and other adaptive manufacturing technologies, a transformation from deliberate planning to “think it … have it” had occurred, empowering me to procrastinate longer than I’d ever dreamed possible. The organizers went on to ponder, “Will space transformation also affect society?”, just as our team at the Air Force Research Lab’s (AFRL) Center for Rapid Innovation (CRI) were working alongside partners within our larger Integrated Capabilities Directorate, NASA’s Flight Opportunities and Small Spacecraft Technology programs, and DARPA’s Luna-10 program to develop technologies and execute demonstration missions that leverage the space domain to genuinely connect even the most remote and austere domains on the timeline of need. Picking apart the miracle that is Amazon prime, where does the model fail, and why? More relevantly to the theme of this year’s symposium, how can the space domain be used to overcome its limitations and minimize its weaknesses? Perhaps it is best assessed in the context of Use Cases. What are the Amazon delivery cost, schedule, and cargo limiters to the Amundsen-Scott South Pole Research Station, or the Lunar South Pole Research Station? This paper will explore enabling infrastructure that allows Amazon prime to thrive and assess the transformational enabling technologies that would be necessary to extend that miracle to the truly remote or the truly austere. Localizing the Remote • First, it will evaluate the ability of the on-going AFRL Rocket Cargo and Space Initiatives Ringside Seats systems, coupled with Astrobotic’s Xodiak and Xogdor capabilities, developed to support the NASA Flight Opportunities Program (FOP), to supply orbital/suborbital delivery to both improved and austere sites on the Earth and Moon. • Then, it will add the surface terminal distribution leg, with an examination of Lunar Outpost’s Mobile Autonomous Prospecting Platform (MAPP), equipped with Mobile Autonomous Robotic Swarm (MARS) software, and Intuitive Machine’s Hopper, developed with support of AFRL and NASA’s Commercial Lunar Payload Services (CLPS) program. Connecting the Isolated From there, it will focus on the destination, asking what implied destination services are required to support highly assured autonomous delivery. • Specifically, it will highlight Astrobotic’s Skymage mesh-networked publish and subscribe communication and navigation service, as well as AFRL’s on-going developments of radioisotope and reactor nuclear-sourced thermoelectric power generation and distribution systems under development under the Joint Emergent Technology Supplying On-orbit Nuclear Power (JETSON) program by Lockheed Martin, Westinghouse, Intuitive Machines, and Zeno Power, to provide the power service to locations well off the grid. • Finally, the paper will connect to the “human machine”. What connects the remote or in-situ human consumer to the remote domain? What connects the diverse international government and commercial services to each other? The former will focus on AFRL’s OraCloud feeding their Space Defense Control and Characterization System (SDCCS) and Lunar Station’s MoonHacker systems, while the latter will focus on the BlueHalo/Tensor LunX Technology Platform for the Cislunar Commodity Marketplace. In 1984, Krafft Ehricke famously remarked that, “If God wanted man to become a spacefaring species, He would have given man a Moon.” This paper is not about the Moon, but is about humans as a spacefaring species, shedding the pesky land/air limitations of the Amazon Prime model … so that we can all live a procrastinator’s “think it … have it” existence.

Charles Finley↗
NASA NTRS2005

Self-Examination

The operation of the new U.S./Canadian Orbiter Boom Sensor System (OBSS) by the STS-114 Discovery's crew "will be the most complicated space robotics job of the shuttle program," say Paul Hill, lead flight director. The OBSS is a laser-and-imaging-sensor- equipped 50-ft. extension to the existing 50-ft. arm, increasing the shuttle's reach to 100 ft. The return-to-flight mission will debut the autonomous robotic self-inspection capability to detect and possibly aid the repair of the type of damage that doomed Columbia and her crew, were it to occur again. With 3D imaging and laser contour-mapping capability, the OBSS will enable the diagnosis of cracks in reinforced carbon-carbon (RCC) wing and nose areas and thermal protection system (TPS) tiles beyond the view of the standard manipulator arm. Given the major changes to the shuttle external tank, no damage is expected. But the OBSS is a direct response to the Columbia Accident Investigation Board's recommendations. The new boom and a significant amount of its supporting software was developed by MacDonald Dettwiler heads. Space and Advanced Robotics Ltd. (MD Robotics) in Brampton, Ontario, a key contractor in the shuttle program for 25 years. The Canadian Space Agency is also heavily involved in supporting shuttle and International Space Station (ISS) robotics.

Covault, Craig↗
NASA NTRSDate not supplied

Investigating Laser Beam Welding as an In-Space Joining Technique via Thermal Vacuum and Microgravity and Vacuum Experiments

In-space joining technologies are crucial for stimulating an in-space economy and for enabling sustained space exploration by in-space manufacturing and repair of metallic structures. Compared to brazing or soldering, in-space welding (ISW) can provide highly hermetic, strong, and complex joints, potentially without introducing additional material. However, the influence of extreme temperatures, reduced pressure, and reduced gravity on ISW is not yet fully elucidated. Several efforts at NASA are investigating laser beam welding (LBW) as a joining and repair method in both thermal vacuum (TVAC) and combined vacuum & reduced gravity environments. NASA Marshall Space Flight Center (MSFC) shepherded several ISW projects in its past, including the 1973 electron beam welding on Skylab, the 1989 low-power LBW on parabolic flights, and the unflown 1990s-era In-Space Welding Experiment. Recent parabolic flights and 3 degree-of-freedom ground testing build upon this heritage. A collaboration with the Ohio State University using NASA Langley Research Center (LaRC) hardware retrofitted for LBW achieved the first high-powered laser welds under vacuum and low gravity and developed a workforce capable developing such experimental hardware. A ground testing campaign at the MSFC Flat Floor simulated fit-up and welding representative of ISW in 3 degrees of freedom to emulate microgravity effects on inertial systems. One ongoing effort is a NASA Early Career Initiative project – Lunar Assembly and Servicing by Autonomous Robotics (LASAR). Ruggedized LBW components were developed by an external partner for use in TVAC. A TVAC-rated robotic arm was procured by MSFC and used in the first known robotic laser weld where all components save the laser generator were under vacuum. NASA Johnson Space Center (JSC) is advancing supervised autonomy of ISW. NASA LaRC continues to adapt their unique snowflake joint geometry, suitable for connecting segments in trusses and other structures, to LBW. Upcoming TVAC campaigns will focus on testing extreme temperatures, proving out autonomous operations, and demonstrating weld repair. Weld inspection will occur via a non-contact nondestructive evaluation (NDE) technique – electromagnetic acoustic transduction (EMAT). Another ongoing effort based at MSFC is the DISCMAN -- DIsk-Shaped Configurable and Modular vAcuum uNit – which seeks to development a compact, modular payload that can provide a vacuum environment while in a reduced gravity condition. This payload could support multiple in-space manufacturing developmental efforts, with the first demonstration technology being LBW. Currently, the design is targeting operations in the pressurized volume of a space station, but the payload could readily be adapted to other flight platforms such as parabolic or even suborbital vehicles. LASAR elucidates the effects of temperature and vacuum on LBW while DISCMAN probes those of vacuum and gravity. Through these complementary efforts, NASA is addressing the primary challenges of ISW across the space environment while simultaneously developing and maturing technologies including robotic systems and inspection methodologies for future practical implementation on the Moon and beyond. This approach is timely, as upcoming missions requiring sustained human presence in space will depend on reliable ISW capabilities to create robust metallic joints currently unproven in the space environment and to perform repairs in situ .

hypogravity↗
NASA NTRS1987

Telerobot for space station

The Flight Telerobotic Servicer (FTS), a multiple arm dexterous manipulation system, will aid in the assembly, maintenance, and servicing of the space station. Fundamental ideas and basic conceptual designs for a shuttle-based telerobot system have been produced. Recent space station studies provide additional concepts that should aid in the accomplishment of mission requirements. Currently, the FTS is in contractual source selection for a Phase B preliminary design. At the same time, design requirements are being developed through a series of robotic assessment tasks being performed at NASA and commercial installations. A number of the requirements for remote operation on the space station, necessary to supplement extravehicular activity (EVA), will be met by the FTS. Finally, technology developed for telerobotics will advance the state of the art of remote operating systems, enhance operator productivity, and prove instrumental in the evolution of an adaptive, intelligent autonomous robot.

Jenkins, Lyle M.↗
NASA NTRS1995

Human-like Compliance for Dexterous Robot Hands

This paper describes the Active Electromechanical Compliance (AEC) system that was developed for the Jau-JPL anthropomorphic robot. The AEC system imitates the functionality of the human muscle's secondary function, which is to control the joint's stiffness: AEC is implemented through servo controlling the joint drive train's stiffness. The control strategy, controlling compliant joints in teleoperation, is described. It enables automatic hybrid position and force control through utilizing sensory feedback from joint and compliance sensors. This compliant control strategy is adaptable for autonomous robot control as well. Active compliance enables dual arm manipulations, human-like soft grasping by the robot hand, and opens the way to many new robotics applications.

Compliant Control↗
DOE OSTI2020

TORONE: Total Characterisation by Remote Observation of Nuclear Environments - 20591

This paper describes the autonomous robotic systems developed in the TORONE project (Total Characterisation by Remote Observation of Nuclear Environments) for combined characterisation by remote techniques in nuclear environments. There are four main components to the system. Firstly, robot operation which uses a Robot Operating System (ROS) allowing ease of communication between hardware and software alongside robot vision systems such as Lidar and/or photogrammetry. Secondly, radiation detection instrumentation for gamma and neutron sources which is also collimated for spatial resolution. Thirdly, photonic characterisation instrumentation for remote material identification by means of Raman spectroscopy and Laser induced breakdown spectroscopy (LIBS). Finally, a data management system is described which contains the TORONE characterisation data with the ability to overlay material characterisation information onto 3D maps of the nuclear environment. Preliminary results are described alongside discussion of some of the synergies of the combined approach. There are many applications of such an autonomous system in nuclear decommissioning, waste management and asset management. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS1989

The 3D model control of image processing

Telerobotics studies remote control of distant robots by a human operator using supervisory or direct control. Even if the robot manipulators has vision or other senses, problems arise involving control, communications, and delay. The communication delays that may be expected with telerobots working in space stations while being controlled from an Earth lab have led to a number of experiments attempting to circumvent the problem. This delay in communication is a main motivating factor in moving from well understood instantaneous hands-on manual control to less well understood supervisory control; the ultimate step would be the realization of a fully autonomous robot. The 3-D model control plays a crucial role in resolving many conflicting image processing problems that are inherent in resolving in the bottom-up approach of most current machine vision processes. The 3-D model control approach is also capable of providing the necessary visual feedback information for both the control algorithms and for the human operator.

Nguyen, An H.↗
NASA NTRS1991

Toward autonomous driving: The CMU Navlab. I - Perception

The Navlab project, which seeks to build an autonomous robot that can operate in a realistic environment with bad weather, bad lighting, and bad or changing roads, is discussed. The perception techniques developed for the Navlab include road-following techniques using color classification and neural nets. These are discussed with reference to three road-following systems, SCARF, YARF, and ALVINN. Three-dimensional perception using three types of terrain representation (obstacle maps, terrain feature maps, and high-resolution maps) is examined. It is noted that perception continues to be an obstacle in developing autonomous vehicles.

Thorpe, Charles↗
NASA NTRS1994

Lunar exploration rover program developments

The Robotic All Terrain Lunar Exploration Rover (RATLER) design concept began at Sandia National Laboratories in late 1991 with a series of small, proof-of-principle, working scale models. The models proved the viability of the concept for high mobility through mechanical simplicity, and eventually received internal funding at Sandia National Laboratories for full scale, proof-of-concept prototype development. Whereas the proof-of-principle models demonstrated the mechanical design's capabilities for mobility, the full scale proof-of-concept design currently under development is intended to support field operations for experiments in telerobotics, autonomous robotic operations, telerobotic field geology, and advanced man-machine interface concepts. The development program's current status is described, including an outline of the program's work over the past year, recent accomplishments, and plans for follow-on development work.

Klarer, P. R.↗
NASA NTRS2010

Establishing a Robotic, LEO-to-GEO Satellite Servicing Infrastructure as an Economic Foundation for Exploration

The strategy for accomplishing civilian exploration goals and objectives is in the process of a fundamental shift towards a potential new approach called Flexible Path. This paper suggests that a government-industry or public-private partnership in the commercial development of low Earth orbit to geostationary orbit (LEO-to-GEO (LTG)) space, following or in parallel with the commercialization of Earth-to-LEO and International Space Station (ISS) operations, could serve as a necessary, logical step that can be incorporated into the flexible path approach. A LTG satellite-servicing infrastructure and architecture concept is discussed within this new strategic context. The concept consists of a space harbor that serves as a transport facility for a fleet of specialized, fully- or semi-autonomous robotic servicing spacecraft. The baseline, conceptual system architecture is composed of a space harbor equipped with specialized servicer spacecraft; a satellite command, communication, and control system; a parts station; a fuel station or depot; and a fuel/parts replenishment transport. The commercial servicer fleet would consist of several types of spacecraft, each designed with specialized robotic manipulation subsystems to provide services such as refueling, upgrade, repair, inspection, relocation, and removal. The space harbor is conceptualized as an ISS-type, octagonal truss structure equipped with radiation tolerant subsystems. This space harbor would be primarily capable of serving as an operational platform for various commercially owned and operated servicer spacecraft positioned and docked symmetrically on four of the eight sides. Several aspects of this concept are discussed, such as: system-level feasibility in terms of ISS-truss-type infrastructure and subsystems emplacement and maintenance between LEO and GEO; infrastructure components assembly in LEO, derived from ISS assembly experience, and transfer to various higher orbital locations; the evolving Earth-to-orbit (ETO) capability to deliver humans and cargo to LEO for assembly purposes; system architectural definition, optimal orbital parameters, mass estimations, delta velocity ( V) estimations, power and propulsion options, and assessments of various critical technologies. Large-scale, robotic, LTG satellite servicing is considered as an essential economic pre-condition and next parallel or sequential step on the road toward exploration beyond LEO. Such a step might produce the necessary pre-requisite economic value that can be used by future decision makers to justify further investment in exploration beyond LEO.

Horsham, Gary A. P.↗
NASA NTRS2020

Supervised Autonomy for Communication-Degraded Subterranean Exploration by a Robot Team

The importance of autonomy in robotics is magnified when the robots need to be deployed and operated in areas that are too dangerous or not accessible for humans, ranging from disaster areas (to assist in emergency situations) to Mars exploration (to uncover the mystery of our neighboring planet). The DARPA Subterranean (SubT) Challenge presents a great opportunity and a formidable robotics challenge to foster such technological advancement for operations in extreme and underground environments. Robot teams are expected to rapidly map, navigate, and search underground environments including natural cave networks, tunnel systems, and urban underground infrastructure. Subterranean environments pose significant challenges for manned and unmanned operations due to limited situational awareness. In the first phase of the DARPA Subterranean Challenge (held in August 2019; targeting underground tunnels and mines), Team CoSTAR, led by NASA JPL, placed second among 11 teams across the world, accurately mapping several kilometers of two mine systems and localizing 17 target objects in the course of four one-hour missions. While the main goal of Team CoSTAR at the end of this threeyear challenge (August 2021) is a fully autonomous robotic solution, this paper describes Team CoSTAR’s results in the first phase of the challenge (August 2019), focusing on supervised autonomy of a multi-robot team under severe communication constraints. This paper also presents the design and initial results obtained from field test campaigns conducted in various tunnel-like environments, leading to the competition.

Otsu, Kyohei↗
NASA NTRS1988

Mars rover sample return: An exobiology science scenario

A mission designed to collect and return samples from Mars will provide information regarding its composition, history, and evolution. At the same time, a sample return mission generates a technical challenge. Sophisticated, semi-autonomous, robotic spacecraft systems must be developed in order to carry out complex operations at the surface of a very distant planet. An interdisciplinary effort was conducted to consider how much a Mars mission can be realistically structured to maximize the planetary science return. The focus was to concentrate on a particular set of scientific objectives (exobiology), to determine the instrumentation and analyses required to search for biological signatures, and to evaluate what analyses and decision making can be effectively performed by the rover in order to minimize the overhead of constant communication between Mars and the Earth. Investigations were also begun in the area of machine vision to determine whether layered sedimentary structures can be recognized autonomously, and preliminary results are encouraging.

Rosenthal, D. A.↗
NASA NTRS2004

Bioinspired Engineering of Exploration Systems (BEES) - its Impact on Future Missions

This paper describes an overview of our "Bioinspired Engineering of Exploration Systems for Mars" ( "BEES for Mars") project. The BEES approach distills selected biologically inspired strategies utilizing motion cues/optic flow, bioinspired pattern recognition, biological visual and neural control systems, bioinspired sensing and communication techniques, and birds of prey inspired search and track algorithmic systems. Unique capabilities so enabled, provide potential solutions to future autonomous robotic space and planetary mission applications. With the first series of tests performed in September 2003, August 2004 and September 2004, we have demonstrated the BEES technologies at the El Mirage Dry Lakebed site in the Mojave Desert using Delta Wing experimental prototypes. We call these test flyers the "BEES flyer", since we are developing them as dedicated test platform for the newly developed bioinspired sensors, processors and algorithmic strategies. The Delta Wing offers a robust airframe that can sustain high G launches and offers ease of compact stowability and packaging along with scaling to small size and low ReynOld's number performance for a potential Mars deployment. Our approach to developing light weight, low power autonomous flight systems using concepts distilled from biology promises to enable new applications, of dual use to NASA and DoD needs. Small in size (0.5 -5 Kg) BEES Flyers are demonstrating capabilities for autonomous flight and sensor operability in Mars analog conditions. The BEES project team spans JPL, NASA Ames, Australian National University (ANU), Brigham Young University(BYU), DC Berkeiey, Analogic Computers Inc. and other institutions. The highlights from our recent flight demonstrations exhibiting new Mission enabling capabilities are described. Further, this paper describes two classes of potential new missions for Mars exploration: (1) the long range exploration missions, and (2) observation missions, for real time imaging of critical ephemeral phenomena, that can be enabled by use of BEES flyers. For example, such flyers can serve as a powerful black-box for critical descent and landing data and enablers for improved science missions complementing and supplementing the existing assets like landers and rovers by providing valuable exploration and quick extended low-altitude aerial coverage of the sites of interest by imaging them and distributing instruments to them. Imaging done by orbiters allows broad surface coverage at limited spatial resolution. Low altitude air-borne exploration of Mars offers a means for imaging large areas, perhaps up to several hundred kilometers, quickly and efficiently, providing a close-up birds-eye view of the planetary terrain and close-up approach to constrained difficult areas like canyons and craters. A novel approach to low-mass yet highly capable flyers is enabled by small aircraft equipped using sensors and processors and algorithms developed using BEES technology. This project is focused towards showing the direct impact of blending the best of artificial intelligence attributes and bioinspiration to create a leap beyond existing capability for our future Missions.

navigation↗
NASA NTRS1991

Higher-order neural network software for distortion invariant object recognition

The state-of-the-art in pattern recognition for such applications as automatic target recognition and industrial robotic vision relies on digital image processing. We present a higher-order neural network model and software which performs the complete feature extraction-pattern classification paradigm required for automatic pattern recognition. Using a third-order neural network, we demonstrate complete, 100 percent accurate invariance to distortions of scale, position, and in-plate rotation. In a higher-order neural network, feature extraction is built into the network, and does not have to be learned. Only the relatively simple classification step must be learned. This is key to achieving very rapid training. The training set is much smaller than with standard neural network software because the higher-order network only has to be shown one view of each object to be learned, not every possible view. The software and graphical user interface run on any Sun workstation. Results of the use of the neural software in autonomous robotic vision systems are presented. Such a system could have extensive application in robotic manufacturing.

Reid, Max B.↗
NASA NTRS2017

NIAC Phase II Orbiting Rainbows: Future Space Imaging with Granular Systems

Inspired by the light scattering and focusing properties of distributed optical assemblies in Nature, such as rainbows and aerosols, and by recent laboratory successes in optical trapping and manipulation, we propose a unique combination of space optics and autonomous robotic system technology, to enable a new vision of space system architecture with applications to ultra-lightweight space optics and, ultimately, in-situ space system fabrication. Typically, the cost of an optical system is driven by the size and mass of the primary aperture. The ideal system is a cloud of spatially disordered dust-like objects that can be optically manipulated: it is highly reconfigurable, fault-tolerant, and allows very large aperture sizes at low cost. This new concept is based on recent understandings in the physics of optical manipulation of small particles in the laboratory and the engineering of distributed ensembles of spacecraft swarms to shape an orbiting cloud of micron-sized objects. In the same way that optical tweezers have revolutionized micro- and nano-manipulation of objects, our breakthrough concept will enable new large scale NASA mission applications and develop new technology in the areas of Astrophysical Imaging Systems and Remote Sensing because the cloud can operate as an adaptive optical imaging sensor. While achieving the feasibility of constructing one single aperture out of the cloud is the main topic of this work, it is clear that multiple orbiting aerosol lenses could also combine their power to synthesize a much larger aperture in space to enable challenging goals such as exo-planet detection. Furthermore, this effort could establish feasibility of key issues related to material properties, remote manipulation, and autonomy characteristics of cloud in orbit. There are several types of endeavors (science missions) that could be enabled by this type of approach, i.e. it can enable new astrophysical imaging systems, exo-planet search, large apertures allow for unprecedented high resolution to discern continents and important features of other planets, hyperspectral imaging, adaptive systems, spectroscopy imaging through limb, and stable optical systems from Lagrange-points. Furthermore, future micro-miniaturization might hold promise of a further extension of our dust aperture concept to other more exciting smart dust concepts with other associated capabilities. Our objective in Phase II was to experimentally and numerically investigate how to optically manipulate and maintain the shape of an orbiting cloud of dust-like matter so that it can function as an adaptable ultra-lightweight surface. Our solution is based on the aperture being an engineered granular medium, instead of a conventional monolithic aperture. This allows building of apertures at a reduced cost, enables extremely fault-tolerant apertures that cannot otherwise be made, and directly enables classes of missions for exoplanet detection based on Fourier spectroscopy with tight angular resolution and innovative radar systems for remote sensing. In this task, we have examined the advanced feasibility of a crosscutting concept that contributes new technological approaches for space imaging systems, autonomous systems, and space applications of optical manipulation. The proposed investigation has matured the concept that we started in Phase I to TRL 3, identifying technology gaps and candidate system architectures for the space-borne cloud as an aperture.

Quadrelli, Marco B.↗
DOE OSTI2023

Inverse reinforcement learning control for building energy management

Reinforcement learning (RL) based control is widely considered a promising approach in building automation and control as it has demonstrated the potential to deal with complex objectives in adjacent domains like robotics, autonomous vehicles, gaming applications, and advertisement recommendations. When applied to any environment, model-free RL learns to improve its control performance over time without requiring a control model, by receiving and then analyzing feedback from the building environment after each control action. Operational objectives are becoming increasingly complex through the simultaneous consideration of thermal comfort, carbon emissions, grid services, and indoor air quality. In this context, conventional rule-based control approaches are proving sub-optimal, mostly heuristic, and inadequate. The model-free and self learning nature of RL appears promising and attractive as it may address the scalability issues associated with advanced control approaches. However, it suffers from long training times and unstable control behavior during the early stages of its learning process, which makes it unsuitable to be applied directly to buildings. This paper addresses these issues using an inverse reinforcement learning approach (IRL), a technique utilized to learn the objective of a controller agent which is considered an expert in its respective domain. Here, we consider a rule-based control as the expert demonstrator. IRL is different from a direct imitation (i.e., direct mapping of states to actions) of control actions as it tries to find the underlying intent of an expert's policy, providing the controller with a better-generalized policy for unseen states or environments with slightly different dynamics. This approach propels the RL controller's policy to levels similar to or better than that of a rule-based policy before it starts learning by interacting with the building. This makes RL for building energy management applications more practical as it prevents the erratic and exploratory behavior in the initial training period, simultaneously speeding up the learning process when compared to applying an untrained RL agent directly to a building environment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗