SEARCH · Search NASA

Results for “Human in the Loop”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

Managing the Digital Thread for Structural Applications With Fit for Purpose Materials

With the increased emphasis on reducing the cost and time to market of new materials, the need for analytical tools that enable the virtual design and optimization of materials throughout their processing - internal structure - property - performance envelope, along with the capturing and storing of the associated material and model information across its lifecycle, has become critical. This need is also fueled by the demands for higher efficiency in material testing; consistency, quality and traceability of data; product design; engineering analysis; as well as control of access to proprietary or sensitive information. Consequently, at NASA Glenn Research Center a robust information management system that manages the digital thread across the full material life (i.e., capture, analysis, maintenance, and dissemination of data) cycle directed at the design of ‘fit-for-purpose materials’ is under development. To this end the Application Table has been incorporated within NASA Glenn Research Center’s ICME Information Management framework within the ANSYS Granta MI tool. The Application Table provides a place where material and structural application information/requirements can be linked to marry the “design-the-material” (structural engineering) and the “design-with-material” (material science) paradigms and thereby enable application-driven design and optimization of materials and structures. In additional several associated toolsets, specifically: AIMAOS (Automated Information Management Across Organizations and Scales), Py MILab, and JARIMIS (Just A Rather Intelligent Material Interrogation System) are also under development to assist in the judicious automation of this process. AIMOAS offers users an interactive graphical user interface for connecting material information management systems with both commercial and in-house simulation tools at various length scales to enable such automation in the handoff across scales and maintenance of material digital twins and the digital thread. Py MILab, is an automatic framework for the capture, analysis, maintenance, and storage of material test data. Py MILab uses a modular approach for capturing raw data, analyzing the data, and storing the data in a database, interfaced by neutral file structures, to promote plug-and-play capabilities for various analysis types. Finally, JARIMIS is an expert system that integrates various materials informatics tools (e.g., MicroNet, Surrogate ML models, ANSYS Granta MI, etc.) to enable inverse design of materials and facilitate the application of machine learning (ML) and data science with human in the loop decision making to rapidly discover and optimize new materials.

Digital Transformation↗

NASA NTRS2024

Evaluation of Initial and Midterm Air Traffic Procedures for Urban Air Mobility Operations

This paper describes a follow-on joint human-in-the loop (HITL) simulation effort by NASA and Joby Aviation that builds on the results of these previous studies. It extends that work by comparing the LOA condition for Initial UAM operations to Midterm operations that includes corridor airspace structures and some other changes to the operating environment. This is the first reported air traffic controller-in-the-loop evaluation of the corridor condition in a high-fidelity simulation environment. The following sections describe the routes, scenarios, and operating conditions along with metrics used to evaluate feasibility from the air traffic controllers’ perspectives. The results section presents the traffic levels that were feasible in each condition and concludes with recommendations for extending the scope and applicability of evaluations like this one in the future.

Savvy Verma↗

NASA NTRSDate not supplied

A Queuing Theory Approach to Pilot-Controller Coordination for m:N Operations

In recent years, attention and interest by industry and researchers has grown in a control paradigm for remotely piloted aircraft termed “m:N operations.” In an m:N operation, a team of m remote pilots in command (RIPCs) collaboratively manage the flights of N aircraft. A consequence of an m:N concept of operations is that the RPICs will have to switch attention from one aircraft to another and from one task to another. Previous research in m:N operations has focused on the workload experienced by an RPIC and their level of situation awareness on their flights. Researchers have found that RPIC workload and situation awareness are generally sensitive to increasing N, although NASA’s Multi-Vehicle (m:N) Working Group has suggested that the driver of workload/situation awareness is the number of exceptions requiring human intervention as opposed to the value of N itself. In any case, a natural antecedent of workload is task load. In this paper, queueing theory is applied to a 1:N Urban Air Mobility (UAM) air taxi operation in order to estimate pilot task load for managing radio communications with air traffic controllers (ATCs) under increasing N. An M/M/1 queueing system is used to model the RIPC’s servicing of calls and clearance requests (e.g., departure, arrival, or airspace transition) to ATC for the N aircraft. Important parameters for the queueing model are the task arrival rate and the average service time for task completion. Radio communication times from past human-in-the-loop simulation studies are used to measure service times for a 1:4 and 1:12 UAM operation and to interpolate service times for 4 < N < 12. A Monte Carlo method is then employed, using the measured and interpolated service times, to estimate arrival rate and related queueing statistics. The paper concludes by considering the estimated queuing statistics, particularly the RPIC’s utilization (i.e., proportion of time actively servicing tasks), the length of the task queue over time, and the implications for task-balanced system design.

task load↗

NASA NTRSDate not supplied

Pathfinding for Airspace with Autonomous Vehicles (PAAV) ACAS Xr Terminal Area Simulation Overview

This presentation provides an overview of an upcoming human-in-the-loop simulation planned by the Pathfinding for Airspace with Autonomous Vehicles (PAAV) subproject, as part of the Air Traffic Management eXploration project. The study will investigate Detect and Avoid (DAA) concepts in and around the DAA terminal area (DTA). The DTA has received little investigation in real-time, pilot-in-the-loop simulation. This study proposes to use current remotely piloted aircraft system (RPAS) pilots to investigate the effectiveness of current DTA requirements using the FAA's Airborne Collision Avoidance System X for Rotorcraft (ACAS Xr) as the DAA system under test. The findings of this stufy will be used to inform DTA and ACAS Xr standards development. This presentation will be provided to RTCA Special Committee 228 as an overview and as an opportunity to collect feedback from the larger RPAS/DAA community on the study design and key scenarios and metrics. The presentation provides a brief overview of open areas of research with ACAS Xr, the experimental design, the simulation environment and the simulation schedule.

advanced air mobility↗

DOE OSTI2021

Human-automated vehicle interactions

This dissertation is proposed to answer the question: how can the interactions between human and automated vehicles be used to improve the overall performance of automated driving technology? Multiple different modules in automated vehicles such as the perception, motion plan and motion control modules can potentially be benefitted from human-automated vehicle interactions. For perception module, the self-correction of faulty sensors can be achieved using human demonstration data. For motion plan and motion control modules, the performance of the low-level motion controller can be improved with the help of human demonstration, and the behavior of the motion planner can be improved using human intervention data during automated driving. Moreover, a better model for a human driver could improve the overall efficiency and comfort of vehicles in connected mixed traffic. In this dissertation, the technical research toward these goals has been completed and has resulted in several peer-reviewed publications. Optimization methods and model predictive control are used extensively to improve energy efficiency while maintaining safe and comfort driving. An inverse model predictive control (IMPC) method has been developed and it has been proven to be effective in modeling the motion of human driven vehicles. The proposed method has demonstrated its benefits in both connected automated highway driving and the bilateral adaptation of human driver and automated driving controller in human-in-the loop simulations. The proposed future research seeks to broaden the application of IMPC by considering a more comprehensive cost function design and applying it to more complex driving situations.

Guo, Longxiang↗

DOE OSTI2021

HUMAN-AUTOMATED VEHICLE INTERACTIONS

Guo, Longxiang↗

DOE OSTI2022

Teaching AI when to care about gender

Natural Language Processing (NLP) is a branch of Artificial Intelligence (AI) concerned with solving language tasks by modeling large amounts of textual data. Some NLP techniques use word embeddings which are semantic models where machine learning (ML) is used to learn to cluster semantically related words by learning about word co-occurrences in the original training text. Unfortunately, these models tend to reflect or even exaggerate biases that are present in the training corpus. Here we describe the Word Embedding Navigator (WEN), which is a tool for exploring word embedding models. We examine a specific potential use case for this tool: interactive discovery and neutralization of gender bias in word embedding models, and compare this human-in-the-loop approach to reducing bias in word embeddings with a debiasing post-processing technique.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Towards Automated Generation of Chiplet-Based Systems

The Software Defined Architectures (SODA) Synthesizer is an open-source compiler-based tool able to automatically generate domain-specialized systems targeting Application- Specific Integrated Circuits (ASICs) or Field Programmable Gate Arrays (FPGAs) starting from high-level programming. SODA is composed of a high-level frontend, SODA-OPT, which leverages the multilevel intermediate representation (MLIR) framework to interface with productive programming tools (e.g., machine learning frameworks), identify kernels suitable for acceleration, and perform high-level optimizations, and of a state-of-the-art high-level synthesis backend, Bambu from the PandA framework, to generate custom accelerators. One specific application of the SODA Synthesizer is the generation of accelerators to enable ultra-low latency inference and control on autonomous systems for scientific discovery (e.g., electron microscopes, sensors in particle accelerators, etc.). This talk will discuss ongoing work on the SODA synthesizer to enable no-human-in-the-loop generation and design space exploration of the chiplets for highly specialized artificial intelligence accelerators. Connecting these highly specialized chiplets to general-purpose cores or programmable accelerators will allow to quickly deploy autonomous systems for scientific discovery.

Limaye, Ankur M.↗

DOE OSTI2024

Towards Agentic AI on Particle Accelerators

As particle accelerators grow in complexity, traditional control methods face increasing challenges in achieving optimal performance. This paper envisions a paradigm shift: a decentralized multi-agent framework for accelerator control, powered by Large Language Models (LLMs) and distributed among autonomous agents. We present a proposition of a self-improving decentralized system where intelligent agents handle high-level tasks and communication and each agent is specialized control individual accelerator components. This approach raises some questions: What are the future applications of AI in particle accelerators? How can we implement an autonomous complex system such as a particle accelerator where agents gradually improve through experience and human feedback? What are the implications of integrating a human-in-the-loop component for labeling operational data and providing expert guidance? We show two examples, where we demonstrate viability of such architecture.

43 PARTICLE ACCELERATORS↗

DOE OSTI2025

Interactive Rotated Object Detection for Novel Class Detection in Remotely Sensed Imagery

In this paper we propose IRTR-DETR an Interactive and Real-Time Rotated DEtection TRansformer that extends IRTDETR to predict rotated bounding boxes. IRTR-DETR maintains the Human-In-The-Loop (HIL) workflow of IRTDETR but introduces rotation-aware heads for improved detection of objects with arbitrary orientations. Similarly to IRTDETR IRTR-DETR can be trained with a small labeled sample set in an interactive setting but we show that it can also be pretrained on related but not identical data--such as a building damage dataset--before being applied to tasks like identifying buildings under construction. We demonstrate the efficacy of our approach on the publicly available Tiny-DOTA and xBD dataset as well as two study-cases on proprietary datasets of greenhouses and houses under construction ("waffle homes"). Detecting greenhouses is highly relevant in the context of damage assessment while "waffle homes" aid understanding typical floorplans and building codes in different areas both thereby supporting population modeling emergency response and policy planning. Our method outperforms the state of the art in interactive rotated object detection on the Tiny-DOTA dataset by 5.7 percent and improves upon the non interactive RTDETR by 7.85 to 19.39 percent (depending on the number of provided samples) while maintaining its real-time efficiency.

Burges, Marvin [ORNL] (ORCID:0000000312690769)↗

DOE OSTI2025

HEPTAPOD: Orchestrating High Energy Physics Workflows Towards Autonomous Agency

Many workflows in high-energy-physics (HEP) stand to benefit from recent advances in transformer-based large language models (LLMs). While early applications of LLMs focused on text generation and code completion, modern LLMs now support orchestrated agency: the coordinated execution of complex, multi-step tasks through tool use, structured context, and iterative reasoning. We introduce the HEP Toolkit for Agentic Planning, Orchestration, and Deployment (HEPTAPOD), an orchestration framework designed to bring this emerging paradigm to HEP pipelines. The framework enables LLMs to interface with domain-specific tools, construct and manage simulation workflows, and assist in common utility and data analysis tasks through schema-validated operations and run-card-driven configuration. To demonstrate these capabilities, we consider a representative Beyond the Standard Model (BSM) Monte Carlo validation pipeline that spans model generation, event simulation, and downstream analysis within a unified, reproducible workflow. HEPTAPOD provides a structured and auditable layer between human researchers, LLMs, and computational infrastructure, establishing a foundation for transparent, human-in-the-loop systems.

Menzo, Tony [Alabama U.; Fermilab] (ORCID:00000002↗

DOE OSTI2020

Rapid and robust antibody Fab fragment crystallization utilizing edge-to-edge beta-sheet packing

Antibody therapeutics are one of the most important classes of drugs. Antibody structures have become an integral part of predicting the behavior of potential therapeutics, either directly or as the basis of modeling. Structures of Fab:antigen complexes have even greater value. While the crystallization and structure determination of Fabs is easy relative to many other protein classes, especially membrane proteins, broad screening and optimization of crystalline hits is still necessary. Through a comprehensive review of rabbit Fab crystal contacts and their incompatibility with human Fabs, we identified a small secondary structural element from the rabbit light chain constant domain potentially responsible for hindering the crystallization of human Fabs. Upon replacing the human kappa constant domain FG loop (HQGLSSP) with the two residue shorter rabbit loop (QGTTS), we dramatically improved the crystallization of human Fabs and Fab:antigen complexes. Our design, which we call “Crystal Kappa”, enables rapid crystallization of human fabs and fab complexes in a broad range of conditions, with less material in smaller screens or from dilute solutions.

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRS2001

Astrobiology Sample Analysis as a Design Driver

This effort supports the Astrobiology Objective 8 the Search for LIFE ON MARS PAST AND PRESENT -(Astrobiology Program Office, 1998, p.7). The essential trade analysis is between returning very small samples to the Earth while protecting them versus in situ analysis on Mars. Developing these explicit parameters encompasses design, instrumentation, system integration, human factors and surface operations for both alternatives. This allocation of capability approach incorporates a "humans and machines in the loop" model that recognizes that every exploration system involves both humans and automated systems. The question is where in the loop they occur whether on Earth, in the Mars Base, in the rover or creeping over the Mars surface.

Cohen, Marc M.↗

NASA NTRS1972

A performance measure for manual control systems

A new performance measure is introduced for multivariable closed loop experiments with a human operator. The essential feature of the phase margin performance measure (PMPM) is that the performance of each control loop can be determined independently, with prescribed disturbance and error levels. A variable filter parameter is used as the PMPM within the loop and it assures a high workload at the same time. There is a straightforward relationship between the PMPM and the inner loop feedback augmentation that can be utilized in trade-off studies. An adjustment scheme that seeks the PMPM automatically is described as employed in a single loop control task. This task applies directly to the experimental study of displays for helicopters and VTOL aircraft.

Dukes, T. A.↗

DOE OSTI2023

Advanced Monitoring and Control in the ANL METL Facility Using an Engineering Digital Twin

The potential benefits of using an engineering digital twin to achieve greater autonomy for monitoring and control functions in advanced reactors was investigated for the Mechanisms Engineering Test Loop (METL) liquid sodium facility at Argonne National Laboratory. The METL sodium purification system served as a representative system as it requires significant human in-the-loop interaction to accomplish its design function. The objective was to demonstrate how real-time operation could be automated while preserving oversight of the operator for ensuring that the system design functions are met. A digital twin model of the purification system was developed for both the cold trap purification loop and plugging meter diagnostic loop using information from the METL piping and instrumentation diagram (P&ID). Automated monitoring and diagnosis of component degradation in the METL facility was demonstrated in tests using the PRO-AID health monitoring software with the digital twin model incorporated in the library of components. Component failures were introduced and were successfully diagnosed in real time. These tests serve to demonstrate an advanced monitoring capability able to differentiate sensor degradation from component degradation, to generate a rank ordering of probabilities of different failure mechanisms that serves to circumvent the false alarm problem with current anomaly detection methods, and how facility monitoring can be transformed from anomaly detection to identification of a specific fault. Automated control of the purification system was demonstrated through simulations that exercised a model predictive controller designed using the digital twin model. Results of these simulations compared favorably with experimental data showing very good reference tracking response with negligible overshoot. In conclusion, these pilot tests and simulations successfully demonstrated the use of a digital twin for improved automation of monitoring and control. It was shown how the digital twin enables switching between control modes from cold trap operation where impurities are removed to plugging meter operation where impurity concentrations are measured.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

NASA NTRS1982

An analytical prediction of pilot ratings utilizing human pilot model

In order to analytically predict pilot ratings, an evaluation method of a manual control system which consists of an aircraft and a human pilot, is proposed and examined. The method is constructed upon the assumptions that the control mission determines the critical frequency the pilot should bring to his focus, and that the degree of closed-loop stability and the human compensation necessary to attain the stability determine the human subjective evaluation of the system. As a result, a simple evaluation chart is introduced. The chart enables prediction of the subjective evaluation, if the controlled element dynamics and the mission are given. The chart is in good accord with almost all of the existing results of pilot ratings. This method has the following advantages: (1) simplicity, in a sense that the method needs to evaluate only two typical controlled element parameters, namely, the gain slope and the phase at the critical control frequency; (2) applicability to unstable controlled elements; (3) predictability of controllability limits of manual control; (4) possibility of estimating human compensatory dynamics.

Tanaka, K.↗

NASA NTRS1989

Stereoscopic distance perception

Limited cue, open-loop tasks in which a human observer indicates distances or relations among distances are discussed. By open-loop tasks, it is meant tasks in which the observer gets no feedback as to the accuracy of the responses. What happens when cues are added and when the loop is closed are considered. The implications of this research for the effectiveness of visual displays is discussed. Errors in visual distance tasks do not necessarily mean that the percept is in error. The error could arise in transformations that intervene between the percept and the response. It is argued that the percept is in error. It is also argued that there exist post-perceptual transformations that may contribute to the error or be modified by feedback to correct for the error.

Foley, John M.↗

NASA NTRS2016

Human Exploration System Test-Bed for Integration and Advancement (HESTIA) Support of Future NASA Deep-Space Missions

The Engineering Directorate at the NASA - Johnson Space Center is outfitting a 20-Foot diameter hypobaric chamber in Building 7 to support future deep-space Environmental Control & Life Support System (ECLSS) research as part of the Human Exploration System Test-bed for Integration and Advancement (HESTIA) Project. This human-rated chamber is the only NASA facility that has the unique experience, chamber geometry, infrastructure, and support systems capable of conducting this research. The chamber was used to support Gemini, Apollo, and SkyLab Missions. More recently, it was used to conduct 30-, 60-, and 90-day human ECLSS closed-loop testing in the 1990s to support the International Space Station and life support technology development. NASA studies show that both planetary surface and deep-space transit crew habitats will be 3-4 story cylindrical structures driven by human occupancy volumetric needs and launch vehicle constraints. The HESTIA facility offers a 3-story, 20-foot diameter habitat consistent with the studies' recommendations. HESTIA operations follow stringent processes by a certified test team that including human testing. Project management, analysis, design, acquisition, fabrication, assembly and certification of facility build-ups are available to support this research. HESTIA offers close proximity to key stakeholders including astronauts, Human Research Program (who direct space human research for the agency), Mission Operations, Safety & Mission Assurance, and Engineering Directorate. The HESTIA chamber can operate at reduced pressure and elevated oxygen environments including those proposed for deep-space exploration. Data acquisition, power, fluids and other facility resources are available to support a wide range of research. Recently completed HESTIA research consisted of unmanned testing of ECLSS technologies. Eventually, the HESTIA research will include humans for extended durations at reduced pressure and elevated oxygen to demonstrate very high reliability of critical ECLSS and other technologies.

Marmolejo, Jose↗