Search NASA⌕ Search

SEARCH · Search NASA

Results for “ISRU”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Solar Versus Fission Surface Power for Mars

A multi-discipline team of experts from the National Aeronautics and Space Administration (NASA) developed Mars surface power system point design solutions for two conceptual missions to Mars using In-situ resource utilization (ISRU). The primary goal of this study was to compare the relative merits of solar- versus fission-powered versions of each surface mission. First, the team compared three different solar-power options against a fission power system concept for a sub-scale, uncrewed demonstration mission. This “pathfinder” design utilized a 4.5 meter diameter lander. Its primary mission would be to demonstrate Mars entry, descent, and landing techniques. Once on the Martian surface, the lander’s ISRU payload would demonstrate liquid oxygen propellant production from atmospheric resources. For the purpose of this exercise, location was assumed to be at the Martian equator. The three solar concepts considered included a system that only operated during daylight hours (at roughly half the daily propellant production rate of a round-the-clock fission design), a battery-augmented system that operated through the night (matching the fission concept’s propellant production rate), and a system that operated only during daylight, but at a higher rate (again, matching the fission concept’s propellant production rate). Including 30% mass growth allowance, total payload masses for the three solar concepts ranged from 1,128 to 2,425 kg, versus the 2,751 kg fission power scheme. However, solar power masses increase as landing sites are selected further from the equator, making landing site selection a key driver in the final power system decision. The team also noted that detailed reliability analysis should be performed on daytime-only solar power schemes to assess potential issues with frequent ISRU system on/off cycling.

Rucker, Michelle A.↗

Testing and Modeling of the Mars Atmospheric Processing Module

Here we report further progress in the development of the MARCO POLO-Mars Pathfinder Atmospheric Processing Module (APM). The APM is designed to demonstrate in situ resource utilization (ISRU) of the Martian atmosphere, which primarily consists of carbon dioxide (CO2). The APM is part of a larger project with the overall goal of collecting and utilizing CO2 found in the atmosphere and water in the regolith of Mars to produce methane and oxygen to be used as rocket propellant, eliminating the need to import those to Mars for human missions, thus significantly reducing costs. The initial focus of NASA's new ISRU Project is modeling of key ISRU components, such as the CO2 Freezers and the Sabatier reactor of the APM. We have designed models of those components and verified the models with the APM by gathering additional data for the Sabatier reactor. Future efforts will be focused on simultaneous operations of the APM and other MARCO POLO-Mars Pathfinder modules.

propellant production↗

Testing and Modeling of the Mars Atmospheric Processing Module

Here we report further progress in the development of the MARCO POLO-Mars Pathfinder Atmospheric Processing Module (APM). The APM is designed to demonstrate in situ resource utilization (ISRU) of the Martian atmosphere, which primarily consists of carbon dioxide (CO2). The APM is part of a larger project with the overall goal of collecting and utilizing CO2 found in the atmosphere and water in the regolith of Mars to produce methane and oxygen to be used as rocket propellant, eliminating the need to import those to Mars for human missions, thus significantly reducing costs. The initial focus of NASA's new ISRU Project is modeling of key ISRU components, such as the CO2 Freezers and the Sabatier reactor of the APM. We have designed models of those components and verified the models with the APM by gathering additional data for the Sabatier reactor. Future efforts will be focused on simultaneous operations of the APM and other MARCO POLO-Mars Pathfinder modules.

Mars In Situ Resource Utilizatio↗

Progress Towards Modeling a Rapid Cycle Adsorption Pump for CO2 Compression

A Rapid Cycle Adsorption Pump (RCAP) is a competitive technology for capturing and pressuring CO2 within a Martian In-Situ Resource Utilization (ISRU) system. In an ISRU plant, CO2 from the Martian atmosphere at ~0.69-0.925kPa must first be pressured to ~101-500kPa to produce O2 and/or CH4. A RCAP pressurizes CO2 by imposing fast temperature swings on an adsorbent bed low pressure CO2 is adsorbed onto the cooled bed, and higher pressure CO2 is desorbed from the heated bed. To aid the design of a RCAP for NASA's Advanced Exploration Systems (AES) ISRU project, a finite difference thermal model of a single stack RCAP was developed in Thermal Desktop. The stack consists of one gas passage sandwiched between two sorbent beds and two cold plates (for heating/cooling each bed). The model implements adsorption/desorption physics via a linear driving force approximation in order to predict both temperature and pressure swings in the pump. The modeling approach is presented along with a discussion of its results and the current design. The model was also used to trade cooling speed when constructing the RCAP with 3D printed high thermal conductivity copper (GRCop-84) verses 3D printed aluminum (AlSi10mg). A wide assembly was modeled to predict the performance of multiple stacks in parallel. Major performance drivers were identified to be 1) the contact heat transfer to the sorbent bed, and 2) the pump's thermal mass.

Modeling↗

JSC-Rocknest: a Large-Scale Mojave Mars Simulant (MMS) Based Soil Simulant for In-Situ Resource Utilization Water-Extraction Studies

The Johnson Space Center Rocknest (JSC-RN) simulant was developed in response to a need by NASA's Advanced Exploration Systems (AES) In Situ Resource Utilization (ISRU) project for a simulant to be used in component and system testing for water extraction from Mars regolith. JSC-RN was de-signed to be chemically and mineralogically similar to material from the aeolian sand shadow named Rocknest in Gale Crater, particularly the 1-3 weight percentage water release as measured by the Sample Analysis at Mars (SAM) instrument. Rocknest material is a proxy for average martian soils, which are unconsolidated and could be easily scooped by rovers or landers in order to extract water. One way in which water can be extracted from aeolian material is through heating, where adsorbed and structural water is thermally removed from minerals. The water can then be condensed and used as drinking water or split and used as propellant for spacecraft or as a source of breathable O2. As such, it was essential that JSC-RN contained evolved gas profiles, especially low temperature water (less than 400 degrees Centigrade), that mimicked what is observed in martian soils. Because many of these ISRU tests require hundreds of kilograms of Mars soil simulant, it was essential that JSC-RN be cost-effective and based on com-ponents that could be purchased commercially (i.e., not synthesized in the lab). Here, we describe the JSC-RN martian soil simulant, which is ideal for large-scale production and use in ISRU water extraction studies.

Hogancamp, J. V.↗

Resources from Water-Rock Interactions for Future Human Exploration of Mars

One of the most exciting endeavors in modern space exploration is extended human exploration of the Moon and Mars. We have entered a new phase in the human venture where we seek to expand our "...presence deeper into space and to the Moon for sustainable long-term exploration and utilization". With this endeavor come new challenges. Among them is the requirement for In Situ Resource Utilization (ISRU) methods to supplement or replace materials transported from Earth. The energy required to leave Earth's gravity well is immense, as is well illustrated by the nearly 3000 metric ton Saturn V required to deliver a payload of less than 50 metric tons to the Moon during the Apollo era. Much of this mass is propellant. Launch vehicles from Earth into space are generally 85 to 95% propellant (oxidizer + fuel) by mass. Potential ascent vehicles from Mars would also need to be approximately 80% propellant by mass to return to Earth. ISRU of fuel reactants could exchange delivered fuel mass directly for payload mass on the order of several metric tons. Devices like MOXIE are being designed to address the oxidizer component. However, 40% of the propellant mass in an ascent vehicle is the fuel reactant, and ISRU of this component has not been addressed for Mars or the Moon. Toward addressing this need, we have begun to develop and optimize methods to generate and recover fuel components, including H2, from Lunar and Martian relevant materials as potential in situ resources for future extended human missions. Hydrogen is an ideal resource to target. Not only can H2 be used directly as part of a propellant, it can also be used as a component in other fuels, such as methane. It is useful agriculturally for fixing nitrogen and can be oxidized to produce heat and water.

Adcock, C. T.↗

Marangoni effect and its potential utilization in supporting lunar habitats and other extraterrestrial endeavors

Tears of wine is a phenomenon frequently observed as a ring of wine formed near the top of the glass generates droplets that fall back into the wine. This phenomenon can be explained by the Marangoni effect driven by the surface tension created via gradient on concentration and temperature along with the interface between two phases. Besides being observed while drinking wine, the Marangoni effect is crucial for welding metals, manufacturing integrated circuits, and growing crystals; the Marangoni effect might be also crucial in supporting lunar habitats and other extraterrestrial endeavors as vacuum and reduced gravity are expected to augment the Marangoni effect on extraterrestrial molten soil leading to sustainable extraterrestrial in-situ resources utilization (ISRU). Preliminary Marangoni effect assessment on molten lunar regolith was conducted via JSC-1A lunar regolith simulant under vacuum yielding a spontaneous upwards migration of a uniform molten thin-film front that climbed the crucible wall covering the entire wall’s surface and reaching the crucible’s top end. A temperature gradient within the melt’s bulk and along the crucible’s wall generates a surface tension large enough not only to form a meniscus within the three-phase junction (crucible’s wall, bulk melt, and vacuum) but also to supersede the gravitational force to create the upwards migration of a thin film front originated on the meniscus. The observed extensive wettability of the melt with the crucible surface, an additional key factor besides surface tension necessary to sustain upwards migration, is atypical to what it has been witnessed on molten JSC-1A lunar regolith simulant under non-vacuum conditions and smaller sample sizes. The unique formation and self-migration of a thin-film front could enable key ISRU processes such as thin-film coating, crystal growth, and feedstock generation for additive 3D printing. Further assessment on the higher-temperature vacuum-driven decomposition of the uniform thin-film front as it climbed the crucible’s wall revealed a significant decomposition of various simulant’s metal-oxide components into their respective oxygen and metal elements strengthening the feasibility of extraterrestrial generation and fractional separation of oxygen and metals/alloys with none or minimal need for terrestrial precursors. The Marangoni effect assessment on molten JSC-1A lunar regolith simulant clearly opens novel pathways in future extraterrestrial ISRU endeavors including manufacturing and mining. Extraterrestrial mining will require an operational approach completely different from the terrestrial one that heavily relies on not only mechanical excavation and transportation but also post-processing; an in-situ all-in-one process might be feasible via these two coupled phenomena, self-migration and decomposition.

J A Dominguez↗

Updated Human Mars Ascent Vehicle Concept in Support of NASA’s Strategic Analysis Cycle 2021

The NASA Artemis program has brought significant change to the agency’s human exploration strategy over the last several years. The human exploration of Mars remains an ultimate objective of the overall human exploration strategy. However, how the agency intends to execute initial human exploration of Mars has shifted to better align with current policy. These changes find their way into the design of key architecture elements, such as the Mars Ascent Vehicle (MAV). Of the numerous changes in the conceptual human Mars architecture, two in particular have had significant impact on the design of the human MAV: the desire for minimal surface infrastructure for initial human Mars missions, and technology investment timelines in support of initial human missions to Mars. The first leads to a surface mission architecture targeting a 30-day surface duration with two crewmembers. The second drives out in-situ resource utilization (ISRU) from the initial sortie. As a result, the reference MAV design for initial human Mars missions in the Human Exploration and Operations Mission Directorate’s Strategic Analysis Cycle 2021 (SAC21) is based around supporting the return of 2 crew from the surface of Mars, without surface ISRU. This has led to several design changes since 2019, when details of a reference human MAV were last published. The MAV concept for SAC21 consists of a two-stage vehicle capable of supporting two crew for 84 hours. This duration is derived from a baseline ascent trajectory targeting an apoapsis rendezvous with the habitation element in a nominal 5-sol Mars aggregation orbit. With the goal of minimizing technology investments for the initial surface sortie removing ISRU from the trade space, the MAV must now be landed either fully loaded with propellant, or with some portion of the propellant off-loaded. Landing a partially-fueled MAV will require additional surface assets to perform robotic propellant transfer on the surface of Mars from a pre-emplaced propellant depot. Furthermore, cryogenic fluid management and storage for extended duration with no losses represents additional technology investment that would have to be made to support cryogenic-based propellant concepts that have been the baseline in past architectures. As a result, the SAC21 architecture utilizes a storable propellant-based MAV propulsion system to minimize these potential technology investments incurred by cryogenic-based propulsion systems. Recent efforts also focused on evaluating the sensitivity of key design parameters, such as landing site latitude, elevation, and local atmospheric conditions. All play a large role in determining the predicted propellant requirements of the MAV. Understanding their potential impacts is important because of the rippling effects of changes to the MAV design on other architecture elements, such as entry, descent, landing, and transportation systems. Results indicate up to +2% to -4% wet mass variation due to landing site latitude, with higher latitudes greater than 70 degrees North resulting in greater than 6% wet mass increases. The MAV saw reduced impact due to atmospheric design parameters, which only accounting for -0.6% to +0.4% wet mass variation.

Douglas J. Trent↗

Developing Mass Spectrometry for Water Quantitation and Volatiles Analysis from In-Situ Regolith

With a revived focus to create a sustainable hu-man presence on the moon, and in preparation for future Mars exploration, it is imperative that all resources are utilized to their fullest potential [1]. In-Situ Resource Utilization (ISRU) will be critical for future mission success as it would enable in-dependent operation of missions while reducing the dependence on the complex supply chain created between the Earth, the moon and Mars. One of the most critical resources that has been identified for ISRU on the lunar surface is water [2]. Water is a versatile resource that can be used in various space operations, such as ra-diation shielding and conversion to oxygen (O2) for propellant [3,4]. One of the most water rich resources is thought to be within the regolith lo-cated in the permanently shadowed regions (PSR) of the Moon; several upcoming missions, such as PRIME-1 and VIPER, are already sched-uled to confirm this hypothesis [5,6]. However, there are currently no missions planned to quanti-fy the abudance of water at these regions. The quantity of water contained in the ice will inform and help the development of future ISRU plants and operation. Water and other volatile gases can be detect-ed upon controlled heating of icy lunar regolith for an accurate quantification of water. This method is similar to thermogravimetric analysis, which was used to analyze Apollo lunar regolith sam-ples. However, losses via sublimation/evaporation or contamination may have occurred with the samples due to the transit and exposure to the terrestrial environment. Furthermore, water would not be expected for these samples since they were not collected from a PSR. Thus, for more accurate results, icy lunar regolith should be ana-lyzed in situ to provide the most representative composition of both water and other volatile gas-es. The Light Water Analysis and Volatile Extract (LightWAVE) project aims to address this knowledge gap. A system has been developed to collect, heat and analyze evolved gases from lu-nar regolith on the lunar surface. The gases will be analyzed by a modified commercial off the shelf (COTS) residual gas analyzer (RGA) quad-rupole mass spectrometer. Evolved gases from heated regolith samples can be identified by the observed mass-to-charge (m/z) ratios, and the peak intensities correlate to the abundances of the observed gases for quantitation. Therefore, our group is developing a calibration methodology utilizing a COTS RGA to quantitate water from in-situ regolith samples on the lunar surface. The partial pressure of water and ideal gas law will be used to quantify the total water evolved from a regolith sample. Here we present our methodol-ogy for the design and calibration for water quan-titation using a COTS RGA.

Nilab Azim↗

Modular Open Systems Approach (MOSA) for a Robust Commercial Lunar Ecosystem

Modular Open Systems Approaches (MOSAs) have been adopted worldwide to solve a myriad of challenges. Open systems by their nature maximize accessibility, reduce barriers to entry, and prevent vendor lock. Similarly, modularity speeds innovation, fosters design re-use, and enables incremental development & growth. Architectures developed using a MOSA synergize the benefits of modularity and open systems to produce better products at lower developmental cost and risk, saving the consumer money while allowing greater developer profit margins. Specific to the challenge of lunar exploration, a MOSA will ensure interoperability among diverse commercial, government, and international partners. Complex spaceflight systems can be assembled, upgraded, and serviced far more easily and with greater commercial involvement with the use of a MOSA. By allowing partners to self-limit their scope to key strengths, they can focus on producing premier components without carrying the high risk and associated cost of auxiliary tasks they don’t specialize in. We survey commercial and Department of Defense (DoD) lessons learned in past decades, discuss DoD robotics’ experience in Iraq and Afghanistan (first without then with MOSAs), and analyze the flourishing commercial ecosystem that has resulted from DoD MOSA adoption. We explore the future of lunar operations to demonstrate the criticality of MOSA adoption in key areas at the right time. Two specific lunar technical fields are studied as examples: Power and In-Situ Resource Utilization (ISRU). Finally, recognizing that the lunar ISRU campaign will be an eminently collaborative operation requiring seamless partnering among diverse commercial, government, and international partners, a comprehensive technology development ecosystem is explored aimed at enabling ISRU in a way that systems and components are affordable for commercial partners to design, build, and sustain.

Mathew DeMinico↗

Investigating the Applications of In-Situ Resource Utilization for Future Crewed Mars Missions

Several advancements are necessary before humans can safely explore Mars. One emerging strategy is In-Situ Resource Utilization (ISRU): the process of extracting raw materials found onsite and converting them into usable products to ensure a constant flow of vital resources and greatly reduce overall mission cost. Scientists must confirm the presence and accessibility of these resources for future crewed missions. Our team investigated the feasibility of ISRU in NE Syrtis, a region of Mars with varied geology, mineralogy, and hydrological history. NE Syrtis has abundant subsurface water and a diverse suite of mineral deposits including olivine, phyllosilicates, sulfates, and carbonates–all of which can be leveraged for fuel, medical supplies, and/or construction materials. We conceptualized a joint rover and helicopter expedition to analyze and sample these minerals over a two-year primary mission using Java Mission-planning and Analysis for Remote Sensing (JMARS), Planetary Data Systems (PDS), and Computer-Aided Design (CAD). We plotted a strategic traverse to regions of interest identified from remote sensing data and planned operations at each target. Our mission aimed to prepare for human presence on Mars by demonstrating the utility and viability of ISRU-focused operations.

Zahra M. Ronizi↗

Mini Roxy: the Next Step Towards an Efficient Method for Oxygen Extraction From Regolith

Space exploration will be enabled by ISRU provided that ISRU processes meet the following viability criteria: the mass of resources produced must exceed the mass of ISRU plant that produces them, and the mass of resources produced per unit time must significantly exceed the mass of consumables or spare parts per unit time that are required to maintain the production process

A. Seidel↗

Space Rated High Voltage Plasma Generating Supply

The use of plasma for in-situ resource utilization (ISRU) applications (such as water treatment, acid production, plant seed activation, biofilm sanitization, or waste gasification) is an active area of research at the KSC Applied Chemistry Lab (ACL). The generation of plasma for experimentation has thus far been done with lab-rated power supplies which are unsuitable for space applications, and no suitable supply is readily available for purchase. This project tackled the development of a low TRL prototype 500 W power supply intended for generating plasma in space. The design was based on similar power electronic circuits used for electric propulsion systems and was adapted for use in ISRU applications. This technology will enable KSC’s plasma-based ISRU related technologies to be demonstrated in the space environment.

Nathaniel Cain↗

Investigation of Lunar-Inspired Geopolymer Concrete Formulations Mixed and Cured in Microgravity on the International Space Station (ISS)

The research outlined in this presentation investigates the use of various lunar regolith simulants in geopolymer lunar concrete mixes mixed and cured on the International Space Station (ISS). The motivation for this work is to study the effects of gravity on the microstructure of alkali-activated materials cured with heat, and to develop materials for the construction of long-term infrastructure on the lunar surface with in-situ resource utilization (ISRU). ISRU for construction materials reduces the cost and mass of payloads related to lunar construction. The advantage of geopolymer concrete as opposed to traditional portland cement concrete is that water acts as a medium for the polymerization reaction and leaves the system throughout the process, reducing its demand. Twelve samples of lunar regolith simulant and a solution composed of sodium hydroxide and sodium silicate were sent to the ISS. The three simulants were OPRH2N, OPRL2N, and JSC-1AF, using only particles less than 53 µm in diameter to increase reactivity of the simulant. Simulant to solution ratios were determined by workability while mixing. The simulant and solution were sealed Burst Pouches® along with 2 other sealed bags to prevent material from leaking. Crew member F-14 conducted testing on the ISS by introducing the solution to the simulant in the Burst Pouch®, mixing the sample with a spatula, and then clamping the specimen in the fresh state to prevent flow inside the Burst Pouch®. These specimens were then put in a thermos heated to 80C via sealed drinking water bags to cure for 24 hours with a temperature logger. The cured specimens remained in microgravity for at least 28 days and were returned from the ISS in February 2025. The specimens were then brought to the NASA Marshall Space Flight Center (MSFC) to analyze. Material characterization consisted of conducting Micro-CT tests of entire samples in their sealed apparatus to a resolution of 25µm. 2D image slices were saved in each orthogonal direction of each specimen at a 0.03 mm step size from the 3D model to conduct analytical porosity calculations. Representative samples from each specimen were sampled to perform helium gas pycnometery and were then mounted in resin for SEM imaging, EDS, and nanoindentation. Porosity was analyzed analytically using micromechanics modelling with the assistance of the NASA Multiscale Analysis Tool (NASMAT), as well as the NASA Advanced Supercomputing (NAS) servers (V. Saseendran & N. Yamamoto, 2024). Density was measured using helium gas pycnometery and was then compared to the theoretical density for experimental porosity calculation. Due to the samples’ non-uniform shape being cured in a pouch, traditional compression and tensile strength testing could not be performed. Nanoindentation was conducted at Clarkson University to determine the microhardness and reduced modulus of elasticity. Results from flight samples can be compared to ground samples currently in DLR’s possession to determine the effect on microstructure from being mixed and cured in microgravity. This study gives further insight and understanding of geopolymer lunar concrete and its viability as a lunar construction material with ISRU.

Adam Johnson↗

Towards the Use of Space Resources

Humans are making technological progress at leveraging resources in space. Ames is a pioneer in In-Situ Resource Utilization (ISRU). ISRU is among the only cost-effective ways to construct habitats off-world.

ISRU↗

Resource Prospector (RP): A Cost-Effective Lunar Resource Pathfinder

Resource Prospector (RP) is an in-situ resource utilization (ISRU) technology demonstration mission under study by the NASA Human Exploration and Operations Mission Directorates (HEOMD). This clever mission is currently planned to launch in 2020 and will demonstrate extraction of oxygen, water and other volatiles, as well measure mineralogical content such as silicon and light metals, like aluminum and titanium, from lunar regolith. Expanding human presence beyond low-Earth orbit to asteroids and Mars will require the maximum possible use of local materials, so-called in-situ resources, and the moon presents a unique destination to conduct robotic investigations that advance ISRU capabilities, as well as providing significant exploration and science value. This mission is equally important; however, for how it executes as a risk-tolerant, cost-effective mission. RP follows on the path-finding approaches of the Lunar Crater Observation and Sensing Satellite (LCROSS) mission. The LCROSS mission confirmed the presence of water-ice on the moon, but also established a new lightweight-approach to project and mission execution which was considerably cheaper and faster than traditional NASA missions. RP has been designated as a Class D mission, just as LCROSS. This mission classification is the most risk-tolerant class of mission within the NASA risk framework and as such, is given more latitude to accept higher-levels of residual risk. The intention is that by saving monies normally spent attempting to assure a single missions success, more missions can be funded. A well-designed portfolio can accept occasional mission failure, as it still gets more done for the same investment of resources. This classification enables tailoring the NASA Policy Requirements (NPRs) to lighter-weight approaches to mission management and execution. RP is also studying both international and commercial partnerships as a means to maximize return on the investment. International partnerships provide both capabilities synergies and cost-sharing opportunities, while the evolving new space commercial options are revealing new approaches to acquiring cost-effective services, including the benefits of bundling services. Even the world of launch vehicles is changing, offering much less expensive access to space, especially if NASA is able to be flexible in how it approaches mission assurance. Finally, leveraging investments being made elsewhere within a program portfolio, can enable cost-savings by enabling two applications with one investment. RP will be the next pathfinder mission to both enable exploration capabilities for future missions, and continue to evolve cost-effective approaches for NASA.

Lunar↗

Towards Autonomous Lunar Resource Excavation via Reinforcement Learning

To continue on a sustainable and flexible path, NASA needs to address the challenge of collecting and moving large amounts of regolith at the destination. NASA’s Regolith Advanced Surface Systems Operations Robot (RASSOR) is principally designed to mine and deliver regolith for In-Situ Resource Utilization (ISRU) processing. RASSOR’s design enables it to efficiently collect and deposit regolith, return collected material for processing, and myriad related ISRU activities. To reliably perform these operations on the lunar surface, RASSOR software and sensory systems need to be robust and maximize the information extracted from a reduced sensor payload. Herein, we present preliminary findings from the Intelligent Capabilities Enhanced RASSOR project. We created reduced-order simulation environments to develop autonomous trenching controllers via reinforcement learning and prototype state estimation architectures. The goal of reinforcement learning is for an agent to learn a policy (task strategy) through interactions with an environment. When the agent performs an action, a change occurs in environment state and a numerical reward is received which informs the agent whether the action performed was good or not. Since reinforcement learning algorithms learn through trial-and-error, a simulation is a desirable first environment for development and learning. We developed two simulations, the first is a 2D excavation simulation developed to facilitate parameter selection, and a 3D simulation developed using a game physics engine, to simulate simplified soil interactions and increase the fidelity of the dynamic models of the robotic agents. The development of this 3D simulation has enabled the training of additional sensing capabilities and research both at the granular mechanics and operations levels. We experimented with various virtual sensor payloads to identify a combination that enabled efficient excavation operation and learning. Our reward function is based on how much material is excavated per step. A penalty is also received for leaving the dig site and to smooth the acceleration of the drum arms. We implemented pseudo time-of-flight sensors to report distance from each drum to ground and the height above ground which was found to be more efficient than existing solutions. Our findings suggest that reinforcement learning for autonomous operations has learned viable trenching strategies within 3000 training episodes in our simplified 2D environment and helped identify desirable sensing capabilities, arrangements, and considerations such as the positioning of time-of-flight sensors. Future work includes expanding our simulation to more complex environments and scenarios, and transfer learning from simulation to RASSOR 2.0 hardware for deployment in the Regolith Test Bin at NASA's Kennedy Space Center.

rassor↗