Search NASASearch

SEARCH · Search NASA

Results for “robotic construction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Teleoperation of Construction Robots Using Human Interaction: Case Study Examples: Preprint

The integration of advanced teleoperation methods in construction robotics has the potential to enhance productivity and safety in demanding environments. Among different methods, hand gestures have emerged as an intuitive approach, enabling seamless communication between human operators and robotic systems. This study demonstrates the use of hand gestures for controlling a model robotic excavator and a virtual robotic arm in construction applications. Two case study examples are presented. In the first case study, a series of hand gestures are performed to control a model robotic excavator's bucket and arm movements. The second case study focuses on using hand gestures to control a virtual robotic arm to perform a material handling task in a simulated environment. In both cases, the performed hand gestures are all successfully captured and interpreted by the gesture-based teleoperation method to conduct the corresponding tasks, which demonstrates the application of the gesture-based control method for various types of construction robots. Also, the limitations of the gesture-based teleoperation method (e.g., recognition delay, sensitivity to motion outliers) are discussed. Future work will focus on developing a digital twin system to support gesture-based teleoperation for a wider range of construction robots.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

Robotics for Energy Infrastructure Construction on Earth and Beyond: Pilot Study Exploring Level 3-4 Semi-Autonomous Installation of a Reduced-Scale Photovoltaic Power Plant Prototype: Preprint

There is a growing need to build energy infrastructure at massive scale on both Earth and in space. On Earth, increasing electricity demand from applications such as AI data centers is driving rapid expansion of power systems, while in space, long-duration missions such as lunar operations require reliable and resilient energy infrastructure that can be deployed quickly. These needs outpace the capabilities of conventional construction methods. Robotic construction offers a path to faster, lower-cost, and more consistent deployment, yet most existing approaches focus on automating individual tasks rather than end-to-end assembly. The Industrialized Construction Innovation (ICI) team at the National Laboratory of the Rockies (NLR), in collaboration with the Colorado School of Mines, has been investigating robotics and automation strategies for rapid end-to-end energy infrastructure construction. This paper presents a pilot study demonstrating level 3-4 semi-autonomous, end-to-end robotic assembly of a reduced-scale photovoltaic power plant prototype under terrestrial conditions. The approach combines hardware redesign of photovoltaic components for robotic compatibility, discrete-event and physics-based robotic simulations in synthetic environments, and sim-to-real deployment to execute end-to-end robotic assembly of[NM1.1][NM1.2] tracking components, structural members, photovoltaic modules, and embedded electrical connections. The pilot identifies key limitations like tolerance management, perception and localization, end effector capability, fastening methods, and multi-physics simulation fidelity, that must be addressed to enable end-to-end robotic assembly of full-scale energy infrastructure. The study highlights how these insights inform scaling strategies for terrestrial energy infrastructure and adaptation to unstructured and extreme environments, including off-world scenarios such as robotic assembly of vertical tall lunar towers.

14 SOLAR ENERGY

NIAC Phase I Final Report Lunar South Pole Oxygen Pipeline (LSPOP)

The Lunar South Pole Oxygen Pipeline (LSPOP) Phase I NIAC, is to analyze the feasibility of constructing a pipeline at the Moon’s South Pole for transporting gaseous oxygen from point of generation to point of use. A lunar pipeline has never been pursued and will revolutionize lunar surface operations for the Artemis program and reduce cost and risk. Our starting concept is for a 5 km pipeline to transport oxygen gas from an oxygen production source, for example from our molten regolith electrolysis (MRE, currently at TRL 5, see references[1],[2],[3],[4],[5],[6] for technical discussions of the MRE process) extraction site, or any other source, to an oxygen storage/liquification plant near a lunar base. The pipeline is designed to: 1) be constructed robotically from regolith-derived metals with minimal material transferred from Earth, 2) be repairable robotically, 3) have an oxygen flow rate of ~2 kg/hour, which is commensurate with the NASA initial projected need of 10,000 kg/year, 4) operate with minimal power over the lifetime of the pipeline, with a goal of high operational reliability and the ability to survive in the lunar environment for > 10 years. We compare this concept to a pipeline concept with pipe produced on Earth and then transported to and assembled on the Moon. Both approaches will use earth-based compressors, valves, and fittings which are integrated into the pipeline on the Moon.

NIAC Phase I

Automated tape-target centering based on template matching for construction measurement tasks using robotic total station

Robotic total stations have transformed surveying and construction mapping through precise, efficient, and automated measurements. These instruments integrate a theodolite, which measures horizontal and vertical angles, with an electronic distance measurement (EDM) unit to determine distances, allowing accurate 3D measurement of observable points. Traditionally, users manually aimed the total station at a target. Recent advancements in robotic motor control and integration of cameras now enable automatic rotation and aiming, typically requiring only a single operator to position the target. Automated aiming is commonly performed using retroreflector prisms, which reflect light back to the source with minimal scattering, enabling high-precision measurements over long distances. However, retroreflectors, especially those designed for 360 degree, can be expensive and impractical for certain applications. This paper presents an algorithm for automating the center detection of low-cost disposable tape targets using the total station's onboard camera and a template matching algorithm. The algorithm identifies the target's center pixel in the image, and the instrument is commanded to aim at that location. We evaluated the performance of this template-matching-based centering method under various distances, angles, lighting conditions, and field environments, comparing its results to both manual aiming and conventional automated aiming of tape targets. Manual aiming was used as the baseline operational reference in the absence of an independent ground-truth measurement. The proposed approach achieves target centering results comparable to the manual baseline. This method provides a cost-effective alternative for high-precision applications where retroreflector targets are constrained by budget or logistics.

Harrington, Joshua [ORNL]

A Real2Sim Digital Twin Pipeline for Photorealistic Robot Simulation: Evaluating VLA Policy Deployment on a Bimanual Mobile Robot

Digital twins that are automatically constructed from robot sensor data offer a promising pathway for scalable Real2Sim and Sim2Real transfer. However, it remains an open question whether photorealistic reconstruction alone is sufficient to support reliable deployment of vision-language-action (VLA) policies. We present a generative-AI-assisted Real2Sim pipeline that generates simulation-ready digital twins from real-world RGB observations with minimal manual intervention. The pipeline uses prompted segmentation to isolate scene components and a generative 3D model to directly produce simulation assets, eliminating the need for traditional multi-view reconstruction or manual 3D modeling.\r\nTo evaluate simulation fidelity, we deploy and compare policies from two VLA models in both the real robot and the reconstructed\r\nsimulation under identical tasks and initial conditions. We compare joint-level action trajectories and analyze how divergence evolves over time in closed-loop execution. Although the reconstructed environments are visually accurate, we observe increasing trajectory divergence during closedloop operation. These results indicate that photorealistic reconstruction alone is insufficient to preserve closed-loop control behavior\r\nin VLA policies, particularly in contact-rich manipulation settings where small perceptual errors compound over time.

97 MATHEMATICS AND COMPUTING

Dynamic analysis of fully constrained Cable-Driven Parallel Robots for automated prefabricated component installation

This paper presents a dynamic analysis and validation framework to assess a fully constrained six-anchor Cable-Driven Parallel Robot (CDPR) for automated installation of prefabricated facade components. Compared with conventional eight-anchor systems, the six-anchor configuration simplifies setup and reduces cost, but it also reduces control authority, shrinks the wrench-feasible workspace, and tightens orientation limits. Consequently, it is unclear a priori whether dynamically feasible trajectories exist to move the end effector from pickup to the facade. A constrained trajectory optimization is formulated to enforce the system dynamics, cable-tension bounds, and pose/velocity limits, and the framework is evaluated in simulation at three levels: (i) an idealized reference model, (ii) a lab-scale prototype model incorporating measured anchor misalignments and identified damping, and (iii) a full-scale three-story building model with load decomposition for structural feasibility checks. Across these scenarios, the analysis shows that optimal, constraint-satisfying trajectories exist that move the end effector from pickup to installation while maintaining a near-plumb, level orientation at the final pose. Collectively, this multi-scale dynamic analysis and validation framework supports the deployment readiness of the six-anchor CDPR and provides a prototype-based sensitivity case study of how measured anchor placement deviations affect feasibility.

CDPR

Synthetic Digital Environments for Training Robots on Earth & Beyond [Poster]

Creating physical replicas of real-world environments to train robots for challenging outdoor tasks, whether constructing energy infrastructure like solar farms on Earth or on the Moon and Mars, is prohibitively expensive. This project will prototype a high-fidelity digital twin framework using NVIDIA IsaacSim to create realistic digital representations of robotic systems and their operating conditions, including varied terrains and environmental factors, allowing robots to learn and adapt in a faster, safer, and more affordable way to tackle unpredictable challenges in terrestrial and extraterrestrial applications. The Robotic Space Exploration (RoSE) Lab at Colorado School of Mines focused on the development and testing of synthetic digital twins to explore multi-physics interactions between robots and unstructured environments, with emphasis on lunar conditions such as deformable regolith, reduced gravity, and terrain-robot contact dynamics. The Industrialized Construction Innovation (ICI) team at National laboratory of the Rockies (NLR), simulated robotic apparatus and construction workflows using synthetic digital twins to inform real-world deployment, targeting application-driven use cases such as robotic construction of a scaled prototype of a photovoltaic energy infrastructure. Joint efforts between RoSE and ICI are continuing to explore how environment-scale multi-physics modeling and application-level robotic system simulation could be integrated to support robotic construction of energy infrastructure in highly unstructured environments, including scenarios relevant to the Lunar South Pole.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

Automated Strain Construction for Biosynthetic Pathway Screening in Yeast

Automation accelerates the Design-Build-Test-Learn (DBTL) cycle for synthetic biology; however, most strain construction pipelines lack robotic integration. Here, in this study, we present the workflow design and source code for a modular, integrated protocol that automates the Build step in Saccharomyces cerevisiae. We programmed the Hamilton Microlab VANTAGE to integrate off-deck hardware via its central robotic arm, enabling automated steps that increased throughput to 2,000 transformations per week. We developed a user interface with the Hamilton VENUS software to support on-demand parameter customization. As a proof of concept, we screened a gene library in an engineered yeast strain producing verazine, a key intermediate in the biosynthesis of steroidal alkaloids. Our pipeline rapidly identified pathway bottlenecks and genes that enhanced verazine production by 2.0- to 5-fold. This technical note provides resources for synthetic biologists designing yeast workflows for biofoundries to screen libraries for pathway discovery/optimization, combinatorial biosynthesis, and protein engineering.

automation

Dynamic Modeling, Trajectory Optimization, and Linear Control of Cable-Driven Parallel Robots for Automated Panelized Building Retrofits

The construction industry faces a growing need for automation to reduce costs, improve accuracy and productivity, and address labor shortages. One area that stands to benefit significantly from automation is panelized prefabricated building envelope retrofits, which can improve a building’s energy efficiency in heating and cooling interior spaces. In this paper, we propose using cable-driven parallel robots (CDPRs), which can effectively lift and handle large objects, to install these panels. However, implementing CDPRs presents significant challenges because of their nonlinear dynamics, complex trajectory planning, and precise control requirements. To tackle these challenges, this work focuses on a new application of established control and trajectory optimization theories in a CDPR simulation of a building envelope retrofit under real-world conditions. We first model the dynamics of CDPRs, highlighting the critical role of damping in system behavior. Building on this dynamic model, we formulate a trajectory optimization problem to generate feasible and efficient motion plans for the robot under operational and environmental constraints. Given the high precision required in the construction industry, accurately tracking the optimized trajectory is essential. However, challenges such as partial observability and external vibrations complicate this task. To address these issues, a Linear Quadratic Gaussian control framework is applied, enabling the robot to track the optimized trajectories with precision. Simulation results show that the proposed controller enables precise end effector positioning with errors under 4 mm, even in the presence of external wind disturbances. Through comprehensive simulations, our approach allows for an in-depth exploration of the system’s nonlinear dynamics, trajectory optimization, and control strategies under controlled yet highly realistic conditions. The results demonstrate the feasibility of CDPRs for automating panel installation and provide insights into their practical deployment.

CDPR

Design and Integration of a Compact Mobile Outdoor Soil Sampling Agricultural Robot

The lack of feedback on soil management for crop systems necessitates the collection of soil samples to derive insights into prevailing soil conditions. Achieving an accurate model of these plantations requires a substantial number of soil samples, which is a labor-intensive process that can suffer from inconsistencies in both the methodology of collection and the locations from which samples are gathered. In addition, the close spacing of crop rows constrains the maneuverability of mobile agricultural equipment during sample collection. This article proposes the use of agricultural robotics to facilitate the acquisition of composite soil samples with minimal human intervention, allowing for precise data collection for a Populus plant system. More specifically, this article presents a case study on the design and construction of a compact agricultural robot for soil sample collection. The performance of the robot, including its soil collection efficacy, maneuverability, and positional accuracy, is evaluated.

42 ENGINEERING

The ReSWARM microgravity flight experiments: Planning, control, and model estimation for on‐orbit close proximity operations

Abstract On‐orbit close proximity operations involve robotic spacecraft maneuvering and making decisions for a growing number of mission scenarios demanding autonomy, including on‐orbit assembly, repair, and astronaut assistance. Of these scenarios, on‐orbit assembly is an enabling technology that will allow large space structures to be built in situ, using smaller building block modules. However, like many of these scenarios, robotic on‐orbit assembly involves several technical hurdles, such as changing system models. For instance, grappled modules moved by a free‐flying “assembler” robot can cause significant changes in the combined system inertia, which have cascading impacts on motion planning and control portions of the autonomy stack. Further, on‐orbit assembly and other scenarios require collision‐avoiding motion planning, particularly when operating in a “construction site” scenario of multiple assembler robots and structures. Multiple key technologies that address these complicating factors for autonomous microgravity close proximity operations are detailed in this work, in particular: (1) application of global long‐horizon planning, accomplished using offline and online sampling‐based planner options that consider the system dynamics; (2) adaptation of the recently proposed RATTLE information‐aware planning framework for on‐orbit reconfiguration model learning; and (3) connection with robust control tools to provide low‐level control robustness using current system knowledge. These approaches were demonstrated for an autonomous on‐orbit assembly use case by the RElative Satellite sWarming and Robotic Maneuvering (ReSWARM) experiments using NASA's Astrobee robots on the International Space Station. Results of the ReSWARM experiments are provided along with significant operational and implementation detail discussing the practicalities of hardware implementation and unique aspects of working with the Astrobee free‐flyer robots in microgravity. ReSWARM provides a base set of planning and control tools for robotic close proximity operations, demonstrates them in microgravity, and outlines some of the important hardware aspects that future autonomous free‐flyers will need to consider.

Robotics

Lab-Scale Cable-Driven Parallel Robot Prototype for Automated Prefabricated Component Manipulation

This paper presents the design and evaluation of a lab-scale cable-driven parallel robot (CDPR) developed as a flexible platform for automated installation of prefabricated components onto exterior building envelopes. Traditional manual installation methods for prefabricated components, which depend on scaffolding, cranes, cherry pickers, and verbal coordination, are not only labor-intensive and error-prone but also face significant limitations in dense urban environments due to site access constraints. To address these challenges, we developed a lab-scale CDPR platform capable of autonomously transporting building envelope components from a designated pickup zone to their target installation location, minimizing the need for human intervention. This study describes the system’s mechanical design, actuation architecture, real-time feedback system, and control strategy of the CDPR, and evaluates its performance in a laboratory environment. The robot’s actuation system uses torque control for end-effector manipulation. The robot’s real-time pose feedback comes from a construction-grade total station and a wireless inertial measurement unit (IMU), which together support precise end-effector control. Experimental results demonstrate the successful integration of the hardware, sensing, state estimation, and control subsystems. Preliminary tests showed that our lab-scale prototype can position the end effector with an error of less than 3 mm, which is a level of precision not previously achieved by existing CDPRs in construction applications. The key findings are twofold: (1) torque-only control is necessary but not sufficient for minimizing final pose error, and (2) incorporating real-time pose feedback can achieve the desired placement accuracy.

Liu, Yifang [Oak Ridge National Laboratory (ORNL),

Design of a robot-automated flat plate/reflection geometry x-ray diffraction setup for accelerated materials discovery and structural screening

Here, we report the design, construction, and automation of a flat plate sample loading, alignment, and data acquisition system for X-ray diffraction measurements in reflection geometry implemented at the Stanford Synchrotron Radiation Lightsource. The system is built onto a single platform, enabling facile transferability, and is compartmentalized into sample storage, sample transfer, and sample position/alignment segments. The core feature of this system is a six-axis robotic arm that offers a large range of highly reproducible and programable movements. The degrees of freedom of the robot arm enable adaptability in which movements can be modified to fit various beamline environments and sample configurations. Samples are housed on 3D printed sample mounts, which are arranged onto a 6 × 2 array of sample cassettes capable of holding 7 samples. Using sample mounts designed for solid oxide electrolysis button cells (SOECs), the maximum tray capacity is 84 samples, which can be aligned and run in ~ 24 hours with long exposure scans. The sample array is additionally capable of accommodating a range of sample sizes and geometries due to the rapid 3D printed fabrication. The components of the setup will be described in detail and performance will be demonstrated with a set of representative SOEC and XRD standard samples. Opportunities for future developments and integration with the automated setup are summarized.

08 HYDROGEN

Laser Beam Welding Advancements for In-Space Servicing, Assembly, and Manufacturing

NASA is currently working to develop in-space servicing, assembly, and manufacturing (ISAM) capabilities for low Earth orbit and the lunar surface. One crucial technology for this effort is laser beam welding. Laser systems can perform joining, cleaning, cutting, and repair activities, which will enable the construction of large in-space structures that could not fit on a single launch vehicle, such as trusses for solar panels, radiators, or communications infrastructure. Multiple projects studying laser welding for space applications are currently underway at NASA Marshall Space Flight Center. One of these, the DIsk-Shaped Configurable and Modular vAcuum uNit (DISCMAN), is a compact vacuum chamber designed to support parameter development for laser welding in microgravity. It contains a rotating platen with weld samples made from aluminum, steel, and titanium, a high-power infrared laser, and integrated pumps for pulling vacuum inside the sample cartridge. The DISCMAN payload is planned to launch to the International Space Station, where welds will be performed under sustained microgravity inside the Bishop Airlock. Another effort underway at Marshall is the Lunar Assembly and Servicing by Autonomous Robotics (LASAR) initiative. This project uses a space-rated robotic arm equipped with a laser weld head, wire feeder, and multiple cameras to perform welds in a thermal vacuum chamber simulating the lunar surface environment. Some of these welds are done on snowflake joints, which are specially designed to slot together to join segments of trussN structures, allowing for the construction of tall surface infrastructure. DISCMAN, LASAR, and other projects are being carried out to advance the technological maturity of in-space laser beam welding, collect data to inform computational models, and learn reliable processes for creating weld joints in space. This work supports NASA’s greater goals to expand humanity’s presence in low Earth orbit, establish a permanent moon base, and eventually send crewed missions to Mars and beyond.

Robotics

Laser Beam Welding Advancements for In-Space Servicing, Assembly, and Manufacturing

NASA is currently working to develop in-space servicing, assembly, and manufacturing (ISAM) capabilities for low Earth orbit and the lunar surface. One crucial technology for this effort is laser beam welding. Laser systems can perform joining, cleaning, cutting, and repair activities, which will enable the construction of large in-space structures that could not fit on a single launch vehicle, such as trusses for solar panels, radiators, or communications infrastructure. Multiple projects studying laser welding for space applications are currently underway at NASA Marshall Space Flight Center. One of these, the DIsk-Shaped Configurable and Modular vAcuum uNit (DISCMAN), is a compact vacuum chamber designed to support parameter development for laser welding in microgravity. It contains a rotating platen with weld samples made from aluminum, steel, and titanium, a high-power infrared laser, and integrated pumps for pulling vacuum inside the sample cartridge. The DISCMAN payload is planned to launch to the International Space Station, where welds will be performed under sustained microgravity inside the Bishop Airlock. Another effort underway at Marshall is the Lunar Assembly and Servicing by Autonomous Robotics (LASAR) initiative. This project uses a space-rated robotic arm equipped with a laser weld head, wire feeder, and multiple cameras to perform welds in a thermal vacuum chamber simulating the lunar surface environment. Some of these welds are done on snowflake joints, which are specially designed to slot together to join segments of trussN structures, allowing for the construction of tall surface infrastructure. DISCMAN, LASAR, and other projects are being carried out to advance the technological maturity of in-space laser beam welding, collect data to inform computational models, and learn reliable processes for creating weld joints in space. This work supports NASA’s greater goals to expand humanity’s presence in low Earth orbit, establish a permanent moon base, and eventually send crewed missions to Mars and beyond.

Manufacturing

Yeast Transformation on Hamilton Vantage (YT Vantage) v1

Our software program is designed for the Hamilton Vantage liquid handling robot, automating the Build step in the Design-Build-Test-Learn (DBTL) cycle for Saccharomyces cerevisiae. This program minimizes human intervention, enabling rapid identification of pathway bottlenecks and genes that enhance verazine production. The program takes competent yeast and plasmid DNA as input and generates an output library of engineered strains compatible with automated colony picking, high-throughput culturing, and chemical extraction for downstream LC-MS analysis. A user-friendly interface, developed using the Hamilton Method Editor software, allows for on-demand parameter customization. By automating this process, our program streamlines the construction of Saccharomyces cerevisiae, reducing manual labor and increasing efficiency. While the manual process is well-documented, integration with robotic automation is less common, making our program a valuable tool for researchers. With this software, we achieved 2-5 fold increases in verazine production, demonstrating its potential to accelerate research in this field.

Louie, Randy [Lawrence Berkeley National Laborator

Autonomous Hydrogen Fueling Station

This project “Autonomous Hydrogen Fueling Station” covered the autonomous refueling with both gaseous hydrogen and liquid hydrogen. The part on gaseous hydrogen focused on the development of an autonomous robotic fueling arm that would couple to a fuel cell engine for hydrogen refueling without guidance from the forklift operator and budget period. Research was also covered for the robotic fueling with a commercial vehicle. The second phase of the project created the baseline for an autonomous liquid hydrogen transfer system that would minimize boil off losses by operating at thermodynamically efficient state points. For the development of the robotic fueling arm, testing was conducted to establish a baseline measurement of the accuracy and repeatability of a human operator positioning a lift truck in front of a dispenser. The goal was to establish the range of motion required for an autonomous fueling mechanism to mate a hydrogen nozzle with a receptacle on a fuel cell system installed in a forklift. The final design comprised a selective compliance articulated robot arm (SCARA)-type mechanism with two arms for horizontal motion and a ball screw for vertical movement and color and LIDAR cameras were used for marker identification and proximity awareness to guide the robotic arm to its target receptacle. Initial tests resulted in 199 out of 200 successful attempts at autonomous coupling of the dispensing coupler and a fuel cell engine, without hydrogen. The dispenser prototype was modified to include tubing for both hydrogen fuel and air purge lines, but subsequent tests were confounded by the shoulder motor over current errors which limited the robot from getting to the fully inserted position to achieve a positive latch. Robotic hydrogen refueling was successfully demonstrated over 1.5 hours of testing, Plug completed 29 successful latches with an average number of 4 sequential latches before failure. However, a robot capable of placing the nozzle with more force is required for higher reliability. For budget period two, a small scale (10 kg / transfer) automated control system was designed that would operate valves to control pressure and flow of liquid nitrogen between a source and receiving tank with an aim to minimize boil off losses by operating at the most thermodynamically efficient state points. Control system logic flow and a P&ID were developed prior to system safety characterization via HAZOP. A control narrative and system state points were defined. Delays in approval for a change of project objective and procurement issues precluded the construction and test of the final prototype system.

08 HYDROGEN

Integrating Machine-learning-assisted Computer Vision with RICH System

Developments in artificial intelligence have vastly expanded the capabilities of robots. Currently, the Spallation Neutron Source (SNS) beamlines at Oak Ridge National Lab (ORNL) have robotic sample loaders to increase the efficiency of running experiments. However, they require retraining if anything about the situation changes, e.g., where the samples are, and cannot notice if errors occur. So, the viability of using computer vision and machine learning to enhance these sample loaders’ functionality was investigated. In this project, the RICH system with a Dobot CR3 6-axis robot present at the VULCAN beamline assisted by an Intel Realsense D435i camera, a unique camera that enables convenient translation of 2D pixel coordinates to 3D world points, was programmed to load ceramic crucibles into a thermogravimetric analyzer (TGA) furnace. An algorithm was constructed in Python with three major phases planned: (1) obtaining a sample, (2) moving it to the target location, and then (3) bringing the sample back to its original location once the experiment finished. In the first phase, the algorithm would dynamically detect sample locations using ArUco markers to recognize the samples’ general location and a custom-trained yolov5 object detection model to locate the crucibles’ centers. Afterward, the robot would be directed to pick up samples based on the crucibles’ calculated positions. In the second phase, the robot would move the sample to a secondary point, reorient its grip, and place the sample at the target location. In the final phase, the robot would determine whether the sample was intact and would bring it back to its original place if it was or raise an alarm. Using this algorithm, the robot was able to pick up different types of crucibles at varying positions. These results indicate that integrating machine-learning-assisted computer vision with robotic sample loaders can result in effective autonomous detection of samples.

97 MATHEMATICS AND COMPUTING