Synthetic Digital Environments for Training Robots on Earth & Beyond [Poster]

Abstract

Creating physical replicas of real-world environments to train robots for challenging outdoor tasks, whether constructing energy infrastructure like solar farms on Earth or on the Moon and Mars, is prohibitively expensive. This project will prototype a high-fidelity digital twin framework using NVIDIA IsaacSim to create realistic digital representations of robotic systems and their operating conditions, including varied terrains and environmental factors, allowing robots to learn and adapt in a faster, safer, and more affordable way to tackle unpredictable challenges in terrestrial and extraterrestrial applications. The Robotic Space Exploration (RoSE) Lab at Colorado School of Mines focused on the development and testing of synthetic digital twins to explore multi-physics interactions between robots and unstructured environments, with emphasis on lunar conditions such as deformable regolith, reduced gravity, and terrain-robot contact dynamics. The Industrialized Construction Innovation (ICI) team at National laboratory of the Rockies (NLR), simulated robotic apparatus and construction workflows using synthetic digital twins to inform real-world deployment, targeting application-driven use cases such as robotic construction of a scaled prototype of a photovoltaic energy infrastructure. Joint efforts between RoSE and ICI are continuing to explore how environment-scale multi-physics modeling and application-level robotic system simulation could be integrated to support robotic construction of energy infrastructure in highly unstructured environments, including scenarios relevant to the Lunar South Pole.