Data-Driven and AI approaches for Robotic Manipulation
Presentation for AI workshop at UNM.
Slightam, Jonathon↗
SEARCH · Search NASA
Results for “robotic manipulation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Estimating Payload Mass during Handling with a Robot Manipulator
Poster for University professor collaborator.
Beaver, Logan E. [Old Dominion University]↗
Optimizing Multi-Robot Placements for Wire Arc Additive Manufacturing
Wire arc additive manufacturing is a metal additive manufacturing process in which the material is deposited using arc welding technology. It is gaining popularity due to high material deposition rates and faster build time. It is en-abled using robotic manipulators and can build relatively large-scale parts faster when compared with other metal additive manufacturing processes. However, the size of the large-scale parts is limited by the size of the industrial manipulator being used for the process. This limitation is overcome by using a fixed configuration multi-robot cell in which manipulators work cooperatively to build large-scale parts quickly. A fixed multi-robot cell with closely spaced industrial manipulators has high flexibility, but it restricts the part size that can be built. If the manipulators are spread out, the cell loses its flexibility but can build relatively larger parts. This issue can be avoided by using larger size manipulators, which are expensive, or by moving the modest size manipulators based on the part geometries. This paper presents a novel algorithm to generate multi-robot placements for different part geometries to be built using wire arc additive manufacturing. Furthermore, the algorithm hierarchically optimizes the build time and the inverse kinematics consistency in robot paths to improve the process efficiency and part quality. We compare the results with fixed multi-robot cells and provide insights to users to make an informed decision on whether to use a fixed or a flexible multi-robot cell for wire arc additive manufacturing.
Bhatt, Prahar↗
Online task-space motion control for positioner-coordinated multi-robot manufacturing systems
Incorporating multiple robotic manipulators into large-scale manufacturing systems enhances production efficiency and expands manufacturing capabilities beyond those of single-robot systems. Workpiece positioners in robotic manufacturing have demonstrated significant benefits for process optimization, but coordination strategies for multi-robot systems with shared positioners have received limited attention. This work presents a task-space coordinated trajectory-tracking control framework for multi-robot manufacturing systems, in which robots coordinate their motions within a shared, dynamic workpiece positioning frame. A workpiece positioner actively adjusts the pose of the manufactured component to enable greater operational concurrency and improve overall production efficiency. The proposed motion-coordination scheme employs a distributed and scalable architecture, supporting coordination across heterogeneous multi-robot systems. Two optimization methodologies are introduced to manage kinematic redundancies and maintain continuous, near-optimal operation throughout the manufacturing process. The first strategy exploits a task-space dimensionality reduction to achieve locally optimal configurations by leveraging symmetry-axis rotations of the tool. The second strategy utilizes the workpiece positioner to drive the coordinated robots toward stable and kinematically favorable configurations. For both optimization strategies, multiple objectives are defined to improve key performance metrics, including manipulability, configuration consistency, proximity to mechanical limits, and motion efficiency. Addressing a key limitation of existing coordination approaches, the framework is designed around online setpoint modification, allowing coordinated robots to respond effectively to in-situ process feedback. The proposed control framework is validated using the Robot Operating System (ROS) middleware on a combination of physical and simulated multi-robot system hardware.
Arbogast, Alex [ORNL] (ORCID:0000000154740723)↗
Pose Estimation for the Inspecta Project
In this addendum report we take the lessons learned from our initial generic object pose estimation research described in (Smartt, et al., 2025) and apply it to metal cup seals, which are attached to items after an international nuclear safeguards inspection (i.e., metal cup seals may be attached to containers of spent nuclear fuel after an inspector has measured and verified the material). We have also refined our software pipeline and training techniques since the final Inspecta report and will describe that process here. The objective of this task is to allow a robot to acquire images of the engraved seal characters to confirm that the correct seal is attached to the correct container. However, the seal may be attached in any orientation and therefore the robot manipulator arm with a camera needs to align with the normal face of the seal.
98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
Automated Plant Tissue Excision and Manipulation via Integrated Robotics and Machine Vision for Plant Transformation
Explore the source record for details and available documents.
Walters, Alex [ORNL] (ORCID:0000000201858725)↗
Design of robot grippers for binder jet products handling
Dimension accuracy, damage minimization, and defect detection are essential in manufacturing processes, especially additive manufacturing. These types of challenges may arise either during the manufacture of a product or its use. The repeatability of the process is vital in additive manufacturing systems. However, human users may lose concentration and, thus, would be a great alternative as an assistant. Depending on the nature of work, a robot’s fingers might vary, for example, mechanical, electrical, vacuum, two-fingers, and three-fingers. In addition, the end effector plays a vital role in picking up an object in the advanced manufacturing process. However, inbuilt robotic fingers may not be appropriate in different production environments. In this research presented here considering metal binder jet additive manufacturing, the two-finger end- effectors are proposed design, analysis, and experiment to pick up an object after completing the production process from a specific location. The final designs were further printed by using a 3D metal printer and installed in the existing robotic systems. These new designs are used successfully to hold the object from the specific location by reducing the contact force that was not possible with the previously installed end effector's finger. In addition, a numerical study was conducted in order to compare the flowability of the geometric shape of finger's free areas.
42 ENGINEERING↗
Lab-Scale Cable-Driven Parallel Robot Prototype for Automated Prefabricated Component Manipulation
This paper presents the design and evaluation of a lab-scale cable-driven parallel robot (CDPR) developed as a flexible platform for automated installation of prefabricated components onto exterior building envelopes. Traditional manual installation methods for prefabricated components, which depend on scaffolding, cranes, cherry pickers, and verbal coordination, are not only labor-intensive and error-prone but also face significant limitations in dense urban environments due to site access constraints. To address these challenges, we developed a lab-scale CDPR platform capable of autonomously transporting building envelope components from a designated pickup zone to their target installation location, minimizing the need for human intervention. This study describes the system’s mechanical design, actuation architecture, real-time feedback system, and control strategy of the CDPR, and evaluates its performance in a laboratory environment. The robot’s actuation system uses torque control for end-effector manipulation. The robot’s real-time pose feedback comes from a construction-grade total station and a wireless inertial measurement unit (IMU), which together support precise end-effector control. Experimental results demonstrate the successful integration of the hardware, sensing, state estimation, and control subsystems. Preliminary tests showed that our lab-scale prototype can position the end effector with an error of less than 3 mm, which is a level of precision not previously achieved by existing CDPRs in construction applications. The key findings are twofold: (1) torque-only control is necessary but not sufficient for minimizing final pose error, and (2) incorporating real-time pose feedback can achieve the desired placement accuracy.
Liu, Yifang [Oak Ridge National Laboratory (ORNL),↗
Nematic Colloidal Micro‐Robots as Physically Intelligent Systems
Abstract Physically intelligent micro‐robotic systems exploit information embedded in micro‐robots, their colloidal cargo, and their milieu to interact, assemble, and form functional structures. Nonlinear anisotropic fluids such as nematic liquid crystals (NLCs) provide untapped opportunities to embed interactions via their topological defects, complex elastic responses, and ability to dramatically restructure in dynamic settings. Here a four‐armed ferromagnetic micro‐robot is designed and fabricated to embed and dynamically reconfigure information in the nematic director field, generating a suite of physical interactions for cargo manipulation. The micro‐robot shape and surface chemistry are designed to generate a nemato‐elastic energy landscape in the domain that defines multiple modes of emergent, bottom‐up interactions with passive colloids. Micro‐robot rotation expands the ability to sculpt interactions; the energy landscape around a rotating micro‐robot is dynamically reconfigured by complex far‐from‐equilibrium dynamics of the micro‐robot's companion topological defect. These defect dynamics allow transient information to be programmed into the domain and exploited. Robust micro‐robotic manipulation strategies are demonstrated that exploit these diverse modes of nemato‐elastic interaction to achieve cargo docking, transport, release, and assembly of complex reconfigurable structures at multi‐stable sites. Such structures are of great interest to future developments of LC‐based advanced optical device and micro‐manufacturing in anisotropic environments.
Yao, Tianyi↗
A Behavioral Robotics Approach to Radiation Mapping Using Adaptive Sampling
Radiation mapping is a desirable task to automate because of the inherent risks involved and its tedious nature. A novel system was designed to address this by combining various existing technologies, utilizing behavior-based robotics and Bayesian optimization. The system uses a quadruped robot equipped with a manipulator and gamma detector to take measurements at locations that are selected based on the uncertainty of a surrogate model used to estimate the true radiation field. The robot uses input from the world with depth cameras to avoid collisions with the robot’s body, and unreachable points for the end effector are addressed by both allowing for a soft collision with the environment to occur, prompting the system to abandon that point, and varying the exploration tendency of the optimization based on consecutive collisions. This approach provides unique traversability and adaptability over other strategies in the literature. Experiments were performed by placing a Cesium-137 source on the ground and varying geometric setups and an optimization parameter demonstrating the adaptability to diverse environments and the increased robustness resulting from the designed behavior. The results additionally demonstrate that dynamically adjusting the optimization algorithm’s exploration tendency based on the arm’s collision history improves the system’s ability to navigate cluttered environments and construct accurate radiation maps without getting stuck in unreachable areas.
Adams, Joel↗
WM26 Paper Multi-Robot Collaboration for Hazardous Environments
Hazardous nuclear and industrial facilities are rarely designed for robots. Work in these domains demand precise manipulation and robust mobility in cluttered, constrained spaces where off-the-shelf platforms struggle and “one-size-fits-all” machines become costly and complex. Idaho National Laboratory (INL) is developing an autonomous, multi-robot inspection system that coordinates task-specific platforms rather than relying on a single omni-tool robot. An electric truck serves as a power and compute hub for a custom manipulator co-developed with Florida International University (FIU), a commercial mini crawler, a pan–tilt–zoom camera, and a Nexxis Argus LiDAR mapping system. Working in concert, these robots generate spatial, radiation, and temperature maps of the pit environments at the Hanford Waste Tank Farms. These systems will capture visual records and environmental telemetry to allow for analysis post inspection. The system architecture uses Robot Operating System 2 (ROS 2) for publish/subscribe integration, NVIDIA Isaac Sim and Unity for simulation and visualization, and algorithms such as NVBlox to fuse data into unified 3D overlays. This robot-agnostic approach reduces operator burden by enabling autonomy across heterogeneous platforms and lets each robot be used where it is strongest. Having autonomous functions means operators don’t have to fully control multiple different components. The ease of use could allow for more widespread adoption of advanced robotics at waste management sites that see continued use. By coordinating simpler, purpose-built mechanisms, the approach lowers design and manufacturing complexity, reduces capital risk in contaminated settings, and improves controllability for complex inspection and manipulation tasks. We present the architecture, early results, and lessons learned from building and deploying this coordinated multi-robot system, with the goal of accelerating safe, cost-effective adoption of advanced robotics at waste-management sites.
42 - ENGINEERING↗
An Approach to Realize Generalized Optimal Motion Primitives Using Physics Informed Neural Networks
Autonomous manipulation is a challenging problem in field robotics due to uncertainty in object properties, constraints, and coupling phenomenon with robot control systems. Humans learn motion primitives over time to effectively interact with the environment. We postulate that autonomous manipulation can be enabled by basic sets of motion primitives as well, but do not necessitate mimicking human motion primitives. Here, this work presents an approach to generalized optimal motion primitives using physics-informed neural networks. Our simulated and experimental results demonstrate that optimality is notionally maintained where the mean maximum observed final position percent error was 0.564% and the average mean error for all the trajectories was 1.53%. These results indicate that notional generalization is attained using a physics-informed neural network approach that enables near optimal real-time adaptation of primitive motion profiles.
97 MATHEMATICS AND COMPUTING↗
WRPS Hanford Update [Slides]
The purpose of this report is to coordinate with the staff from WRPS, the current contract holder for operations at the Hanford site to better inform design decisions for the Autonomous systems for Hanford waste tank handling project. The project goals are to support risk reduction associated with monitoring, inspection and mapping of Hanford tank underground pits and includes: 1. A pit mock-up demonstration of Idaho National Laboratory’s (INL) Autonomous Pit Exploration System (APES) technology, which has two configurations: A. The Autonomous Robotic Arm, which is a proposed collaboration with Florida International University (FIU) and has capabilities to visually inspect, monitor, map and conduct simple tool manipulation tasks in the tank pits, and B. The robotic crawler configuration, which has capabilities to deploy to the bottom of the pits and conduct closer and bottom-up visual inspections. 2. An Implementation Plan that identifies Hanford site-wide application of the INL remote robotics technologies to enhance the performance of the tank farm systems and the characterization of the waste they contain to mitigate risk and optimize the overall waste mission. 3. A first-of-a-kind environmental digital twin will be produced. Digital twins to date require permanently installed sensors in order to produce asset specific predictions. This project will use the intermittent signals during inspections from deployed sensors on robotic systems to produce the data sets used by AI/ML to enable predictions of issues on tanks.
42 - ENGINEERING↗
Data-Driven and Physics informed AI approaches for manipulation
Workshop presentation on the future of work in the age of robotics & AI
Slightam, Jonathon↗
Intern Poster Session 08/13: Autonomous Nuclear Robotics: Applications in nuclear waste inspection and hot cell experiments
The nuclear industry is experiencing renewed interest in autonomous robotics, yet most deployed systems remain teleoperated with limited autonomy. This work presents two contributions toward fully autonomous nuclear robotic systems: autonomous waste inspection at the Hanford Site and an autonomous hot cell laboratory framework. Inspections of Hanford's underground waste storage tanks are performed manually at significant cost and personnel exposure. We developed a reinforcement-learning (RL) training pipeline for a custom-built inspection arm. In parallel, we are designing an autonomous laboratory framework for post-irradiation examination in hot cells at the Specimen Preparation Laboratory (SPL) that integrates computer vision, task and motion planning, hardware execution, and operator-in-the-loop control. These systems demonstrate a path toward safer, more efficient nuclear operations by reducing human exposure while maintaining rigorous human oversight at critical decision points.
11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
Robotic Systems integration for cleanroom SRF assembly at Fermilab
Superconducting Radio Frequency (SRF) cryomodule assembly is a critical process that demands the highest levels of contamination control in a cleanroom to ensure product quality and reliability. Within the cleanroom environment, human-driven activities remain the major source of uncontrolled particulate. Moreover, the precise manual alignment of components often exceeds expected timeframes, increasing the risk of particulate migration into the critical inner space of the SRF resonant cavity, and causing extended discomfort for workers. Automation comes as a natural solution to address these challenges. The goal of this activity is to set up and integrate a robotic system to support cavity coupler installation in the cleanroom environment. Initially, remote control of a 6-axis collaborative robot arm will be implemented as an introductory step towards automation in the cleanroom. Subsequently, the system will be further enhanced by integrating manipulation capabilities through an appropriate end-effector, and computer vision technology to enable accurate pose estimation. This comprehensive approach aims to achieve a fully automated and adaptable assembly process in the partially structured cleanroom environment, thereby enhancing efficiency and mitigating existing challenges for better product quality and workers safety.
42 ENGINEERING↗
Robotic Assembly of SRF Cavity Pair
Superconducting Radio Frequency (SRF) cavities for particle accelerators require tight tolerances, ultrahigh vacuum, and strict cleanliness during assembly. As in the semiconductor industry, defects such as particles and residues are deleterious to performance, possibly rendering a cavity unfit for use. This problem is addressed primarily through cleanroom assembly during sensitive steps and rigorous chemical processing to prevent and remove such defects. Human workers are often the largest source of contamination, even with proper gowning and practices. The semiconductor industry has long integrated robots in cleanroom operation, but this has not occurred for SRF cavity production; SRF cavities, unlike wafers, are complex shapes, require more hands-on mechanical assembly, and are low-volume production items. At Jefferson Laboratory, a co-operative robot (cobot) has been setup to overcome these problems. Cobots are safe for use alongside human workers and can integrate new tools such as a 3D camera part detection and gripper for item manipulation. Therefore, cobots represent a promising avenue for reducing particulate generated during a variety of assembly tasks. A mockup of a cavity pair and coupler was setup and the cobot programmed to automatically pick up the coupler and place on the mating cavity flange. Particle counting methods were setup to measure human vs cobot assembly particulate generation inside a cavity mockup. Other potential uses will be discussed for further improving SRF cavity assembly steps, where a cobot can replace or assist a human operator, and what potential gains are expected.
Duzik, Adam [Thomas Jefferson National Accelerator↗
Field-Driven Out-of-Equilibrium Collective Patterns for Swarm Micro-Robotics
Soft robotics has been rapidly advancing, offering significant improvements over traditional rigid robotic systems through the use of compliant materials that enhance adaptability and interaction with the environment. However, current approaches face critical challenges, including the reliance on complex “top-down” fabrication techniques and the difficulty of wireless powering and control at the microscale. Swarm robotics introduces a paradigm shift, leveraging collective dynamics to achieve cooperative and adaptable behaviors among multiple robotic units. Inspired by nature, this “bottom-up” approach enables swarm robots to execute task-specific reconfigurations, enhancing flexibility and robustness. Field-driven active colloids emerge as a promising platform for swarm microrobotics, capable of self-propulsion and self-organization into dynamic collective patterns under external field excitation and manipulation. These systems mimic biologically inspired swarm behaviors, such as flocking and vortex formation, providing a versatile foundation for designing innovative swarm microrobots. Here, this review discusses the principles of electric and magnetic field-driven collective self-organization, focusing on the particle dynamics, the emergence of collective swarm patterns, and illustrative examples of functional swarm microrobots. It concludes with future perspectives on harnessing these systems for adaptive, scalable, and multifunctional microrobotic applications.
77 NANOSCIENCE AND NANOTECHNOLOGY↗