Search NASA⌕ Search

SEARCH · Search NASA

Results for “human automation robotic integration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Artificial Intelligence: Powering Human Exploration of the Moon and Mars

Artificial Intelligence (AI) is a growing field of computa- tional science techniques designed to mimic functions per- formed by people. Advancements in autonomy will depend on a portfolio of AI technologies. Automated planning and scheduling is a venerable field of study in AI, and is needed for a variety of mission planning functions. Plan execution technology is less well studied, but important for auton- omy and robotics. Specialized forms of automated reason- ing and machine learning are key technologies to enable fault management. Over the past decade, the NASA Au- tonomous Systems and Operations (ASO) project has devel- oped and demonstrated numerous autonomy enabling tech- nologies employing AI techniques. Our work has employed AI in three distinct ways to enable autonomous mission op- erations capabilities. Crew Autonomy gives astronauts tools to assist in the performance of each of these mission oper-ations functions. Vehicle System Management uses AI tech- niques to turn the astronaut's spacecraft into a robot, allow- ing it to operate when astronauts are not present, or to reduce astronaut workload. AI technology also enables Autonomous Robots as crew assistants or proxies when the crew are not present. When these capabilities are used to enable astro- nauts to operate autonomously, they must be integrated with user interfaces, introducing numerous human factors con- siderations; when these capabilities are used to enable vehi- cle system management, they must be integrated with flight software, and run on embedded processors under the control of real-time operating systems.We first describe human spaceflight mission operations capabilities. The remainder of the paper will describe the ASO project, and the development and demonstration per- formed by ASO since 2011. We will describe the AI tech- niques behind each of these demonstrations, which include a variety of symbolic automated reasoning and machine learn- ing based approaches. Finally, we conclude with an assess- ment of future development needs for AI to enable NASA's future Exploration missions.

Mission Operations↗

Engineering, construction, and operations in space - III: Space '92; Proceedings of the 3rd International Conference, Denver, CO, May 31-June 4, 1992. Vols. 1 & 2

The present volume on engineering, construction, and operations in space discusses surface structures on the moon and Mars, surface equipment, construction, and transportation on the moon and Mars, in situ materials use and processing, and space energy. Attention is given to such orbital structures as LEO and the space station, space mining and excavation, space materials, space automation and robotics, and space life support systems. Topics addressed include lunar-based astronomy, space systems integration, terrestrial support for space functions, and space education. Also discussed are space plans, policy, and history, space science and engineering, geoengineering and space exploration, and the construction and development of a human habitat on Mars.

Space life support systems↗

Integrating Electromagnetic Acoustic Transducers in a Modular Robotic Gripper for Inspecting Tubular Components

Tubular structures are critical components in infrastructure such as power plants. Throughout their life, they are subjected to extreme conditions or suffer from defects such as corrosion and cracks. Although regular inspection of these components is necessary, such inspection is limited by safety-related risks and limited access for human inspection. Robots can provide a solution for automatic inspection. The main challenge, however, lies in integrating sensors for nondestructive evaluation with robotic platforms. As part of developing a versatile lizard-inspired tube inspector robot, in this study the authors propose to integrate electromagnetic acoustic transducers into a modular robotic gripper for use in automated ultrasonic inspection. In particular, spiral coils with cylindrical magnets are integrated into a novel friction-based gripper to excite Lamb waves in thin cylindrical structures. To evaluate the performance of the integrated sensors, the gripper was attached to a robotic arm manipulator and tested on pipes of different outer diameters. Two sets of tests were carried out on both defect-free pipes and pipes with simulated defects, including surface partial cracking and corrosion. The inspection results indicated that transmitted and received signals could be acquired with an acceptable signal-to-noise ratio in the time domain. Moreover, the simulated defects could be successfully detected using the integrated robotic sensing system.

Materials Science↗

Operating advanced scientific instruments with AI agents that learn on the job

Advanced scientific user facilities, such as next generation X-ray light sources and self-driving laboratories, are revolutionizing scientific discovery by automating routine tasks and enabling rapid experimentation and characterizations. However, these facilities must continuously evolve to support new experimental workflows, adapt to diverse user projects, and meet growing demands for more intricate instruments and experiments. This continuous development introduces significant operational complexity, necessitating a focus on usability, reproducibility, and intuitive human-instrument interaction. In this work, we explore the integration of agentic AI, powered by Large Language Models (LLMs), as a transformative tool to achieve this goal. We present our approach to developing a human-in-the-loop pipeline for operating advanced instruments including an X-ray nanoprobe beamline and an autonomous robotic station dedicated to the design and characterization of materials. Specifically, we evaluate the potential of various LLMs as trainable scientific assistants for orchestrating complex, multi-task workflows, which also include multimodal data, optimizing their performance through optional human input and iterative learning. We demonstrate the ability of AI agents to bridge the gap between advanced automation and user-friendly operation, paving the way for more adaptable and intelligent scientific facilities.

Large Language Models↗

Yeast Transformation on Hamilton Vantage (YT Vantage) v1

Our software program is designed for the Hamilton Vantage liquid handling robot, automating the Build step in the Design-Build-Test-Learn (DBTL) cycle for Saccharomyces cerevisiae. This program minimizes human intervention, enabling rapid identification of pathway bottlenecks and genes that enhance verazine production. The program takes competent yeast and plasmid DNA as input and generates an output library of engineered strains compatible with automated colony picking, high-throughput culturing, and chemical extraction for downstream LC-MS analysis. A user-friendly interface, developed using the Hamilton Method Editor software, allows for on-demand parameter customization. By automating this process, our program streamlines the construction of Saccharomyces cerevisiae, reducing manual labor and increasing efficiency. While the manual process is well-documented, integration with robotic automation is less common, making our program a valuable tool for researchers. With this software, we achieved 2-5 fold increases in verazine production, demonstrating its potential to accelerate research in this field.

Louie, Randy [Lawrence Berkeley National Laborator↗

Irradiation Assessment of a Lightweight Industrial Robot - Towards Faster, Safer and Sooner Waste Decommissioning - 20317

Robotic systems have been successfully applied in the nuclear industry for several decades as a safe approach to minimize the exposure dose of human operators. As nuclear waste management and decommissioning gathers pace, there is an emerging interest integrating modern off-the-shelf industrial robots in nuclear robotic systems which make use of complex electronics and software to improve functionality over traditional machines. The use of the industrial robots will significantly increase the pace of development of automated waste management systems at a reduced cost, and although these off-the-shelf robots are proven robust in typical industrial environments, performance in radioactive environments is less clear. This paper investigates the performance degradation of a lightweight industrial robot (KUKA iiwa 7 LBR 800) in a controlled radiation field, aiming to simulate conditions in highly radioactive nuclear waste handling facilities. The degradation of the industrial robot's performance is identified while measuring the air kerma dose-tolerance of sensitive components, via a systematic experimental methodology. The experience from this experiment has demonstrated the significant capabilities of industrial robots, which tolerated a large gamma dose of 164 Gy before a system failure. Future tests are planned, aiming to enable faster, safer and sooner waste management and decommissioning using complex robotic systems. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Software Engineering for Human Spaceflight

The Spacecraft Software Engineering Branch of NASA Johnson Space Center (JSC) provides world‐class products, leadership, and technical expertise in software engineering, processes, technology, and systems management for human spaceflight. The branch contributes to major NASA programs (e.g. ISS, MPCV/Orion) with in‐house software development and prime contractor oversight, and maintains the JSC Engineering Directorate CMMI rating for flight software development. Software engineering teams work with hardware developers, mission planners, and system operators to integrate flight vehicles, habitats, robotics, and other spacecraft elements. They seek to infuse automation and autonomy into missions, and apply new technologies to flight processor and computational architectures. This presentation will provide an overview of key software‐related projects, software methodologies and tools, and technology pursuits of interest to the JSC Spacecraft Software Engineering Branch.

Fredrickson, Steven E.↗

Automated and High-Throughput Phase Separation Control for Supramolecular Polymer Blends Enabled by Machine Learning

Supramolecular polymer blends (SPBs) offer tunable morphologies that dictate their macroscopic properties, yet their rational design is limited by the absence of predictive structure−morphology models. Here, we introduce a data-driven highthroughput workflow that integrates modular polymer synthesis, robotic formulation, automated morphology characterization, and machine learning (ML) for accelerated SPB discovery. Using a plug-and-play synthetic strategy, 33 hydrogen-bonding endfunctional homopolymers were prepared and orthogonally combined to generate 260 SPBs in 1 day. A fully automated atomic force microscopy (AFM) pipeline enabled systematic imaging, producing 2340 morphology data sets with minimal human intervention. Domain spacings were extracted through complementary imageprocessing methods and used to train ML models. A support vector regression (SVR) model accurately predicted target phase-separation sizes (50, 100, and 150 nm), which were experimentally validated. This work demonstrates the power of coupling high-throughput experimentation with ML to accelerate morphology discovery and provides one of the first large-scale experimental data sets for supramolecular polymer systems.

ML-guided polymer design↗

Human-rating Automated and Robotic Systems - (How HAL Can Work Safely with Astronauts)

Long duration human space missions, as planned in the Vision for Space Exploration, will not be possible without applying unprecedented levels of automation to support the human endeavors. The automated and robotic systems must carry the load of routine housekeeping for the new generation of explorers, as well as assist their exploration science and engineering work with new precision. Fortunately, the state of automated and robotic systems is sophisticated and sturdy enough to do this work - but the systems themselves have never been human-rated as all other NASA physical systems used in human space flight have. Our intent in this paper is to provide perspective on requirements and architecture for the interfaces and interactions between human beings and the astonishing array of automated systems; and the approach we believe necessary to create human-rated systems and implement them in the space program. We will explain our proposed standard structure for automation and robotic systems, and the process by which we will develop and implement that standard as an addition to NASA s Human Rating requirements. Our work here is based on real experience with both human system and robotic system designs; for surface operations as well as for in-flight monitoring and control; and on the necessities we have discovered for human-systems integration in NASA's Constellation program. We hope this will be an invitation to dialog and to consideration of a new issue facing new generations of explorers and their outfitters.

Baroff, Lynn↗

Control of intelligent robots in space

In view of space activities like International Space Station, Man-Tended-Free-Flyer (MTFF) and free flying platforms, the development of intelligent robotic systems is gaining increasing importance. The range of applications that have to be performed by robotic systems in space includes e.g., the execution of experiments in space laboratories, the service and maintenance of satellites and flying platforms, the support of automatic production processes or the assembly of large network structures. Some of these tasks will require the development of bi-armed or of multiple robotic systems including functional redundancy. For the development of robotic systems which are able to perform this variety of tasks a hierarchically structured modular concept of automation is required. This concept is characterized by high flexibility as well as by automatic specialization to the particular sequence of tasks that have to be performed. On the other hand it has to be designed such that the human operator can influence or guide the system on different levels of control supervision, and decision. This leads to requirements for the hardware and software concept which permit a range of application of the robotic systems from telemanipulation to autonomous operation. The realization of this goal requires strong efforts in the development of new methods, software and hardware concepts, and the integration into an automation concept.

Freund, E.↗

Research in interactive scene analysis

Cooperative (man-machine) scene analysis techniques were developed whereby humans can provide a computer with guidance when completely automated processing is infeasible. An interactive approach promises significant near-term payoffs in analyzing various types of high volume satellite imagery, as well as vehicle-based imagery used in robot planetary exploration. This report summarizes the work accomplished over the duration of the project and describes in detail three major accomplishments: (1) the interactive design of texture classifiers; (2) a new approach for integrating the segmentation and interpretation phases of scene analysis; and (3) the application of interactive scene analysis techniques to cartography.

Tenenbaum, J. M.↗

The NASA Ames Closed Environmental Research Chamber: Present Status

The Closed Environmental Research Chamber (CERC) at the NASA Ames Research Center was created to investigate both components and complete systems for life support of advanced space exploration missions. This facility includes a Main Chamber, an Airlock, a Sample Transfer Lock, a Vacuum System, an Air Recompression System, a dedicated control room and a pit area for housing supporting and environmental control systems. The Main Chamber provides 310 sq ft of internal working/living space on two levels. It is planned that the CERC will be a human-rated facility for habitation simulation under mass balance closure conditions. The internal pressure will be variable over the range of 14.7 psia to 5 psia with accompanying capability for variation in atmosphere composition to maintain the oxygen partial pressure at 160 mm Hg. The CERC will be provided with a core set of primary life support subsystems for temperature and humidity control, C02 removal and trace contaminant control. Interfacing with external life support technology test b~ds with be provided, along with connection to centralized, microprocessor-based data acquisition and control systems. This paper will discuss the current status of the CERC facility and show how it is being used to address the advanced technology requirements necessary to implement an integrated working and living environment for a planetary habitat. In particular, it will be shown how the CERC, along with a human-powered centrifuge, a planetary terrain simulator and advanced displays and a virtual reality capability will work together to develop and demonstration applicable technologies for future planetary habitats. Artificial intelligence and expert system programming techniques will be used extensively to provide an automated environment for a 4-person crew. There will be several robotic mechanisms performing exploration tasks external to the habitat that will be controlled through the virtual environment to provide representative workloads for the crew. Finally, there will be a discussion of how effective are innovative new multidisciplinary test facilities to the investigation of the wide range of human and machine problems inherent in exploration missions.

Gross, Anthony R.↗

Automation of Shuttle Tile Inspection - Engineering methodology for Space Station

The Space Systems Integration and Operations Research Applications (SIORA) Program was initiated in late 1986 as a cooperative applications research effort between Stanford University, NASA Kennedy Space Center, and Lockheed Space Operations Company. One of the major initial SIORA tasks was the application of automation and robotics technology to all aspects of the Shuttle tile processing and inspection system. This effort has adopted a systems engineering approach consisting of an integrated set of rapid prototyping testbeds in which a government/university/industry team of users, technologists, and engineers test and evaluate new concepts and technologies within the operational world of Shuttle. These integrated testbeds include speech recognition and synthesis, laser imaging inspection systems, distributed Ada programming environments, distributed relational database architectures, distributed computer network architectures, multimedia workbenches, and human factors considerations.

Wiskerchen, M. J.↗

Software Innovation in a Mission Critical Environment

Operating in mission-critical environments requires trusted solutions, and the preference for "tried and true" approaches presents a potential barrier to infusing innovation into mission-critical systems. This presentation explores opportunities to overcome this barrier in the software domain. It outlines specific areas of innovation in software development achieved by the Johnson Space Center (JSC) Engineering Directorate in support of NASA's major human spaceflight programs, including International Space Station, Multi-Purpose Crew Vehicle (Orion), and Commercial Crew Programs. Software engineering teams at JSC work with hardware developers, mission planners, and system operators to integrate flight vehicles, habitats, robotics, and other spacecraft elements for genuinely mission critical applications. The innovations described, including the use of NASA Core Flight Software and its associated software tool chain, can lead to software that is more affordable, more reliable, better modelled, more flexible, more easily maintained, better tested, and enabling of automation.

Fredrickson, Steven↗

The use of interactive computer vision and robot hand controllers for enhancing manufacturing safety

Current available robotic systems provide limited support for CAD-based model-driven visualization, sensing algorithm development and integration, and automated graphical planning systems. This paper describes ongoing work which provides the functionality necessary to apply advanced robotics to automated manufacturing and assembly operations. An interface has been built which incorporates 6-DOF tactile manipulation, displays for three dimensional graphical models, and automated tracking functions which depend on automated machine vision. A set of tools for single and multiple focal plane sensor image processing and understanding has been demonstrated which utilizes object recognition models. The resulting tool will enable sensing and planning from computationally simple graphical objects. A synergistic interplay between human and operator vision is created from programmable feedback received from the controller. This approach can be used as the basis for implementing enhanced safety in automated robotics manufacturing, assembly, repair and inspection tasks in both ground and space applications. Thus, an interactive capability has been developed to match the modeled environment to the real task environment for safe and predictable task execution.

Marzwell, Neville I.↗

National Virtual Biotechnology Laboratory: Report on Rapid R&D Solutions to the COVID-19 Crisis

With funding from the CARES Act, the U.S Department of Energy (DOE) established the National Virtual Biotechnology Laboratory (NVBL) in March 2020 to address key challenges associated with the COVID-19 crisis. NVBL brought together the broad scientific and technical expertise and resources of DOE’s 17 national laboratories to help tackle medical supply short ages, discover potential drugs to fight the virus, develop and validate COVID-19 testing methods, model disease spread and impact across the nation, and understand virus transport in buildings and the environment. National laboratory resources leveraged for this effort include a suite of world-leading user facilities broadly available to the research community, such as light and neutron sources, nanoscale science research centers, sequencing and biocharacterization facilities, and high-performance computing facilities. Within months, NVBL teams produced innovations in materials and advanced manufacturing that mitigated shortages in test kits and personal protective equipment (PPE), creating nearly 1,000 new jobs. They used DOE’s high-performance computers and light and neutron sources to identify promising candidates for antibodies and antivirals that universities and drug companies are now evaluating. NVBL researchers also developed new diagnostic targets and sample collection approaches, and supported U.S. Food and Drug Administration (FDA), Centers for Disease Control and Prevention (CDC), and U.S. Department of Defense (DoD) efforts to establish national guidelines used in administering millions of tests. Researchers used artificial intelligence and high-performance computing to produce near-real-time data analysis to forecast disease transmission, stress on public health infrastructure, and economic impact, which supported decision-makers at the local, state, and national levels. NVBL teams also studied how to control indoor virus movement to minimize uptake and protect human health. NVBL’s accomplishments demonstrate not only the powerful resource represented by DOE’s national laboratories working together to meet national needs, but also the effectiveness of the integrated NVBL framework for rapidly responding to emergencies with research and development (R&D) solutions. As the fight against COVID continues, sustained efforts are needed to confront this pandemic as well as future threats. Examples include: 1) Establishing “supply chains on demand” to meet emergency production needs by leveraging the materials and manufacturing expertise of DOE national laboratories and developing advances in electronics, sensing, robotics, and automation capabilities; 2) Improving the speed and robustness of drug discovery by integrating experimental platforms with DOE’s computational and experimental user facilities, which provide unique resources to support the discovery of high-potential therapeutic agents; 3) Protecting public, environmental, and animal health by developing new testing protocols and instrumentation adaptable to diverse sample types (both physiological and environmental) to quickly detect a wide range of pathogens and monitor other biorisks; 4) Supporting near-real-time data needs of decision-makers at the local, regional, state, and national levels by advancing data curation, analysis, and modeling using artificial intelligence and new data science tools for managing and evaluating large diverse datasets; 5) Harnessing DOE’s expertise in environmental modeling to design rooms and air handling for offices, classrooms, restaurants, and other structures to minimize biorisk transmissions. Going forward, NVBL is poised to apply the unique capabilities and expertise of the national laboratory complex to future national and international emergencies, both natural and engineered. Through this framework, the Office of Science will continue to be an integral component of agency wide efforts to prepare for and respond to biorisks and other crises.

42 ENGINEERING↗

Automated Inspection of Criticality Control Overpacks for Surplus Plutonium Disposition: Qualification Update – 25313

In an effort to reduce the amount of nuclear waste in South Carolina, the Department of Energy (DOE) tasked the Savannah River Site (SRS) with diluting and disposing of the amount of plutonium in the state. This process involves the movement and shipment of over 100,000 criticality control overpacks (CCOs) throughout the project lifespan, lending itself to the use of automation to reduce worker radiation exposure and more efficiently utilize human capital. Due to the large scope, this overarching process was broken down into several different “automation projects” to be developed. The first opportunity pursued was the receipt and inspection of empty CCO drums coming into SRS, identified as Automation Project 1 (AP1), and is the focus of this paper. AP1 was developed to unpack incoming CCOs and inspect them for unwanted foreign objects and any damage to the drum or its contents. This process is accomplished by the combination of an automated guided vehicle (AGV) that delivers CCOs to a robotic arm which uses a suite of custom tools to disassemble a CCO, inspect the inside and outside of the CCO and its inner criticality control container (CCC), reassemble the CCC and CCO, and apply a tamper indicating device (TID) to the inspected drum. In past years, the robotic work cell had been developed in a small-scale testing facility for proof-of-concept. This year, major improvements were made to the robotic work cell to perform the process, including integration into the final facility where CCOs will be inspected. Other technical improvements include the implementation of sensor feedback and safety relays into the control system to allow the state of the work cell to be better tracked, and additional development of the TID application process to complete the robotic inspection. Further enhancements were made to the robotic vision processes and robot pathing, as well as development on a computer vision inspection process to detect inspection criteria anomalies in CCOs. In addition to developmental improvements, the work cell underwent a six-month testing period to ensure the project requirements were met. Results of this testing period demonstrate the work cell’s capability to meet project throughput goals at an acceptable level, successfully document the status of each CCO inspected, and reduce the toll on technical operations’ human power by two thirds. At the time of this paper, the work cell is capable of autonomously handling up to eight CCOs with an AGV, delivering CCOs to and from the robot work cell, and having a robotic arm perform a full receipt and inspection procedure on each CCO. Moving forward, repeatability will be improved so that these CCOs can be run back-to-back seamlessly, as well as improving the system to handle more significant edge cases and failure modes.

Spivey, Nicholas↗

Telerobotics for the efficient utilization of space

Telerobotics is a new technology that is being developed to perform remote manipulation in space. It seeks to accommodate the needs arising from a rapidly increasing investment in space assets and from the large costs deriving from human operations in space, especially EVA. Telerobotics applies advanced automation and artificial intelligence technology and combines the immediacy of execution of teleoperation (the replication at a distance of the physical motions of the operator) with the efficiency and precision of supervised robotic autonomy (the accomplishment of assignments through machine task decomposition and interpretation of sensor information). One of the key goals of this approach is the achievement of a seamless transition between teleoperation and supervised autonomy. The basis of this technology and of the NASA telerobotics research and development activities are described. They consist of five elements: core research, laboratory integration testbed, mission analysis, application demonstrations and flight experiments. Current advances, both in research and system integration are reported including the first integration of the laboratory testbed and quantitative comparisons obtained in a buoyant facility. Planned future goals are outlined.

Varsi, Giulio↗