Search NASA⌕ Search

SEARCH · Search NASA

Results for “Human Computer Interaction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

Modeling Humans as Reinforcement Learners: How to Predict Human Behavior in Multi-Stage Games

This paper introduces a novel framework for modeling interacting humans in a multi-stage game environment by combining concepts from game theory and reinforcement learning. The proposed model has the following desirable characteristics: (1) Bounded rational players, (2) strategic (i.e., players account for one anothers reward functions), and (3) is computationally feasible even on moderately large real-world systems. To do this we extend level-K reasoning to policy space to, for the first time, be able to handle multiple time steps. This allows us to decompose the problem into a series of smaller ones where we can apply standard reinforcement learning algorithms. We investigate these ideas in a cyber-battle scenario over a smart power grid and discuss the relationship between the behavior predicted by our model and what one might expect of real human defenders and attackers.

Lee, Ritchie↗
NASA NTRSDate not supplied

Advances in Stereo Photogrammetry Capabilities for in-Situ Ejecta Measurements in Lunar Plume-Surface Interactions

Plume-surface interaction is a critical topic of interest as human spaceflight programs establish a renewed presence on the Moon and push onwards to Mars. The erosion of regolith and high-speed ejection of soil and rocks which occurs during a powered spacecraft landing on lunar or terrestrial bodies can pose serious risks to the vehicle during landing and to existing ground assets. Ground testing campaigns have provided data sets in relevant environments (e.g., low pressure) in tandem with predictive computational model validation. To-date, limited in-situ flight data exists to inform the study of the key phenomena of plume-surface interaction: plume-flow physics, soil erosion, and ejecta dynamics. In two upcoming lunar missions, erosion of the lunar regolith will be measured in-situ using the stereo photogrammetry technique as part of NASA’s Commercial Lunar Payload Services (CLPS) Program. The Stereo Cameras for Lunar Plume Surface Studies (SCALPSS) will use a multiple-camera system to measure the erosion of the lunar regolith due to the vehicles’ rocket engine plumes during descent and after landing. The application of stereo photogrammetry to accurately measure a realistic eroded shape has been validated in laboratory work ahead of the scheduled flights. In preparation for future CLPS, Artemis, or other lunar science missions, recent advancements have been made to measure the ejecta structure and particle dynamics in addition to the erosion of regolith using a SCALPSS-like photogrammetry system. The thickness and ejection angle of entrained soil and dust produced during plume-induced erosion can be used to determine how far debris will travel, and thus how it may impact nearby infrastructure or the landing vehicle itself. The present work highlights the development of this new flight instrumentation capability and its value to advancements in the plume-surface interaction measurement topic for lunar or planetary landings.

Olivia K. Tyrrell↗
NASA NTRS1975

Packaging printed circuit boards: A production application of interactive graphics

The structure and use of an Interactive Graphics Packaging Program (IGPP), conceived to apply computer graphics to the design of packaging electronic circuits onto printed circuit boards (PCB), were described. The intent was to combine the data storage and manipulative power of the computer with the imaginative, intuitive power of a human designer. The hardware includes a CDC 6400 computer and two CDC 777 terminals with CRT screens, light pens, and keyboards. The program is written in FORTRAN 4 extended with the exception of a few functions coded in COMPASS (assembly language). The IGPP performs four major functions for the designer: (1) data input and display, (2) component placement (automatic or manual), (3) conductor path routing (automatic or manual), and (4) data output. The most complex PCB packaged to date measured 16.5 cm by 19 cm and contained 380 components, two layers of ground planes and four layers of conductors mixed with ground planes.

Perrill, W. A.↗
NASA NTRS2010

Reconstituted Three-Dimensional Interactive Imaging

A method combines two-dimensional images, enhancing the images as well as rendering a 3D, enhanced, interactive computer image or visual model. Any advanced compiler can be used in conjunction with any graphics library package for this method, which is intended to take digitized images and virtually stack them so that they can be interactively viewed as a set of slices. This innovation can take multiple image sources (film or digital) and create a "transparent" image with higher densities in the image being less transparent. The images are then stacked such that an apparent 3D object is created in virtual space for interactive review of the set of images. This innovation can be used with any application where 3D images are taken as slices of a larger object. These could include machines, materials for inspection, geological objects, or human scanning. Illuminous values were stacked into planes with different transparency levels of tissues. These transparency levels can use multiple energy levels, such as density of CT scans or radioactive density. A desktop computer with enough video memory to produce the image is capable of this work. The memory changes with the size and resolution of the desired images to be stacked and viewed.

Hamilton, Joseph↗
NASA NTRS1995

At the intersection of automation and culture

The crash of an automated passenger jet at Nagoya, Japan, in 1995, is used as an example of crew error in using automatic systems. Automation provides pilots with the ability to perform tasks in various ways. National culture is cited as a factor that affects how a pilot and crew interact with each other and equipment.

NASA Discipline Space Human Factors↗
NASA NTRS2018

Developing a Natural User Interface and Facial Recognition System With OpenCV and the Microsoft Kinect

The task for this project was to design, develop, test, and deploy a facial recognition system for the Kennedy Space Center Augmented/Virtual Reality Lab. This system will serve as a means of user authentication as part of the NUI of the lab. The overarching goal is to create a seamless user interface that will allow the user to initiate and interact with AR and VR experiences without ever needing to use a mouse or keyboard at any step in the process.

Human Interfaces↗
NASA NTRS2023

Computer Human Interface Challenges in Space Exploration

NASA’s plans to return humans to the Lunar surface require overcoming a variety of challenging technical and operational obstacles. In 2022, NASA formed the Extravehicular Activity (EVA) and Human Surface Mobility (HSM) Program (EHP) at the Johnson Space Center with responsibilities including development of space suits and surface mobility systems for Lunar missions. This program includes a Technology Development and Partnerships office chartered to identify high priority gaps in capabilities for Lunar surface mobility and to coordinate resources to close those gaps. This presentation details the EHP technology roadmap for “Informatics and Decision Support,” a subset of spacecraft avionics focused on effective and autonomous crew interaction with spaceflight systems. The gaps, grouped into displays, audio systems, and information technology infrastructure, are largely driven by the unique interaction requirements for human spacecraft and the severe radiation environments beyond low earth orbit. The roadmap identifies ongoing activities and paths to technology infusion into Lunar spacecraft. NASA is seeking input on the content and ideas for alternative paths to gap closure. Closing these gaps is important to successful human operations on the Lunar surface and vital to NASA’s long-term goal of human missions to Mars.

Spacecraft Displays↗
DOE OSTI2024

CrossMP: Enabling Cross-Modality Translation between Single-Cell RNA-Seq and Single-Cell ATAC-Seq through Web-Based Portal

In recent years, there has been a growing interest in profiling multiomic modalities within individual cells simultaneously. One such example is integrating combined single-cell RNA sequencing (scRNA-seq) data and single-cell transposase-accessible chromatin sequencing (scATAC-seq) data. Integrated analysis of diverse modalities has helped researchers make more accurate predictions and gain a more comprehensive understanding than with single-modality analysis. However, generating such multimodal data is technically challenging and expensive, leading to limited availability of single-cell co-assay data. Here, we propose a model for cross-modal prediction between the transcriptome and chromatin profiles in single cells. Our model is based on a deep neural network architecture that learns the latent representations from the source modality and then predicts the target modality. It demonstrates reliable performance in accurately translating between these modalities across multiple paired human scATAC-seq and scRNA-seq datasets. Additionally, we developed CrossMP, a web-based portal allowing researchers to upload their single-cell modality data through an interactive web interface and predict the other type of modality data, using high-performance computing resources plugged at the backend.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Toward Accelerating Discovery via Physics-Driven and Interactive Multifidelity Bayesian Optimization

Both computational and experimental material discovery bring forth the challenge of exploring multidimensional and often nondifferentiable parameter spaces, such as phase diagrams of Hamiltonians with multiple interactions, composition spaces of combinatorial libraries, processing spaces, and molecular embedding spaces. Often these systems are expensive or time consuming to evaluate a single instance, and hence classical approaches based on exhaustive grid or random search are too data intensive. This resulted in strong interest toward active learning methods such as Bayesian optimization (BO) where the adaptive exploration occurs based on human learning (discovery) objective. However, classical BO is based on a predefined optimization target, and policies balancing exploration and exploitation are purely data driven. In practical settings, the domain expert can pose prior knowledge of the system in the form of partially known physics laws and exploration policies often vary during the experiment. Here, we propose an interactive workflow building on multifidelity BO (MFBO), starting with classical (data-driven) MFBO, then expand to a proposed structured (physics-driven) structured MFBO (sMFBO), and finally extend it to allow human-in-the-loop interactive interactive MFBO (iMFBO) workflows for adaptive and domain expert aligned exploration. These approaches are demonstrated over highly nonsmooth multifidelity simulation data generated from an Ising model, considering spin–spin interaction as parameter space, lattice sizes as fidelity spaces, and the objective as maximizing heat capacity. Detailed analysis and comparison show the impact of physics knowledge injection and real-time human decisions for improved exploration with increased alignment to ground truth. Here, the associated notebooks allow to reproduce the reported analyses and apply them to other systems.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2013

A Situation Awareness Assistant for Human Deep Space Exploration

This paper presents the development and testing of a Virtual Camera (VC) system to improve astronaut and mission operations situation awareness while exploring other planetary bodies. In this embodiment, the VC is implemented using a tablet-based computer system to navigate through inter active database application. It is claimed that the advanced interaction media capability of the VC can improve situation awareness as the distribution of hu man space exploration roles change in deep space exploration. The VC is being developed and tested for usability and capability to improve situation awareness. Work completed thus far as well as what is needed to complete the project will be described. Planned testing will also be described.

Boy, Guy A.↗
NASA NTRS2012

Tactile Data Entry for Extravehicular Activity

In the task-saturated environment of extravehicular activity (EVA), an astronaut's ability to leverage suit-integrated information systems is limited by a lack of options for data entry. In particular, bulky gloves inhibit the ability to interact with standard computing interfaces such as a mouse or keyboard. This paper presents the results of a preliminary investigation into a system that permits the space suit gloves themselves to be used as data entry devices. Hand motion tracking is combined with simple finger gesture recognition to enable use of a virtual keyboard, while tactile feedback provides touch-based context to the graphical user interface (GUI) and positive confirmation of keystroke events. In human subject trials, conducted with twenty participants using a prototype system, participants entered text significantly faster with tactile feedback than without (p = 0.02). The results support incorporation of vibrotactile information in a future system that will enable full touch typing and general mouse interactions using instrumented EVA gloves.

Adams, Richard J.↗
NASA NTRSDate not supplied

NASA Earth System Digital Twins (ESDT) For a Sustainable Future

An Earth System Digital Twin (or ESDT) is an Information System for Understanding, Forecasting, and Conjecturing the complex interconnections among Earth systems, including anthropomorphic forcings and impacts to humanity. More specifically, an Earth System Digital Twin is a dynamic and interactive information system that first provides a digital replica of the past and current states of the Earth or Earth system, as accurately and timely as possible (i.e., the “What Now”); second allows for computing forecasts of future states under nominal assumptions and based on the current replica (i.e., the “What Next”); and third offers the capability to investigate many hypothetical scenarios under varying impact assumptions (i.e., the “What If”). The full power of digital twins is that, through an integrated representation and standardized tools and software technologies, the same digital replica can address the needs of multiple users at various resolutions (spatial and temporal) and for various applications (science, economic, policy, etc.) – “from farmer to scientist”. Since 2020, NASA’s Earth Science Technology’s Intelligent Systems Programs have started defining and investigating ESDTs. After several workshops, more than 15 projects have been funded to develop technologies and components as well as a few prototype ESDT systems. An ESDT architecture framework has been defined, and it is now being used to develop a Coastal Zone Digital Twin (CZ-DT), in coordination with NOAA and CNES. Additional projects have also just been selected to build additional ESDT technologies and prototypes. The details of these Programs will be detailed at the conference.

Earth Science Remote Sensing; Information Systems↗
NASA NTRS1991

Building the Scientific Modeling Assistant: An interactive environment for specialized software design

The construction of scientific software models is an integral part of doing science, both within NASA and within the scientific community at large. Typically, model-building is a time-intensive and painstaking process, involving the design of very large, complex computer programs. Despite the considerable expenditure of resources involved, completed scientific models cannot easily be distributed and shared with the larger scientific community due to the low-level, idiosyncratic nature of the implemented code. To address this problem, we have initiated a research project aimed at constructing a software tool called the Scientific Modeling Assistant. This tool provides automated assistance to the scientist in developing, using, and sharing software models. We describe the Scientific Modeling Assistant, and also touch on some human-machine interaction issues relevant to building a successful tool of this type.

Keller, Richard M.↗
NASA NTRS2022

NASA's Next Generation of Atmospheric Data Science

The Multi-Angle Imager for Aerosols (MAIA) and the Tropospheric Emission: Monitoring of Pollution(TEMPO) are NASA’s next-generation satellite missions for air quality monitoring. These missions will produce high-quality, high-resolution air quality data to support cross-displinary research. The MAIA mission is collaborating with health science researchers and epidemiologists to study the impacts of air quality on health outcomes. TEMPO aims to improve our understanding of tropospheric air pollution chemistry and our ability to make predictions about air quality and climate forcing. TEMPO will offer hourly measurements of tropospheric ozone, aerosols, and clouds focused on North America at high-spatial resolution, while MAIA will produce high-resolution measurements of speciated particulate matter targeting densely populated cities around the globe. Data from these missions will help improve our understanding of the sources, types, and interactions among the aerosols and trace gases that are polluting Earth’s atmosphere, as well as our understanding of the impact of air pollution on pollution on a wide range of important areas including human health, agriculture, weather, and climate change. The challenges of cross-disciplinary research, computationally expensive multi-variate analyses, and high-resolution data at both local and global scales are driving substantial changes across all of NASA’s Distributed Active Archive Centers (DAACs). High resolution data at scales such these requires a new approach to data ingest, archive, and publication. Like other NASA DAACs, the Atmospheric Science Data Center (ASDC), the DAAC that will be responsible for publishing MAIA and TEMPO data products has historically archived and distributed data on premise. DAACs of the future will archive and distribute data in the cloud, enabling them to remake themselves as research-focused data centers that will support on-demand, data-intensive computations for highly accurate retrospective analyses and predictions. Under the new paradigm, data formats and metadata must support on-demand spatial and temporal sub-setting, as well as other data transformation services such as re-gridding and re-sampling. This presentation will discuss work being done to address data formatting and metadata requirements in this dynamic new environment. In addition to the changes in data stewardship practices at the ASDC, the increased focus on supporting scientific research is driving changes in the relationship between DAACs and researchers. While the ASDC will continue to provide first rate data management and stewardship, it is increasingly focused on serving as a partner not only to the science teams that gather and produce the data it publishes, but to the researchers that use that data.

Beth Huffer↗
NASA NTRS2005

Program Predicts Time Courses of Human/Computer Interactions

CPM X is a computer program that predicts sequences of, and amounts of time taken by, routine actions performed by a skilled person performing a task. Unlike programs that simulate the interaction of the person with the task environment, CPM X predicts the time course of events as consequences of encoded constraints on human behavior. The constraints determine which cognitive and environmental processes can occur simultaneously and which have sequential dependencies. The input to CPM X comprises (1) a description of a task and strategy in a hierarchical description language and (2) a description of architectural constraints in the form of rules governing interactions of fundamental cognitive, perceptual, and motor operations. The output of CPM X is a Program Evaluation Review Technique (PERT) chart that presents a schedule of predicted cognitive, motor, and perceptual operators interacting with a task environment. The CPM X program allows direct, a priori prediction of skilled user performance on complex human-machine systems, providing a way to assess critical interfaces before they are deployed in mission contexts.

Vera, Alonso↗
DOE OSTI2026

High-throughput methods leveraging robotics and computer vision for the development of therapeutic phage cocktails

We present the high-throughput automated screening techniques that are being used to develop bacteriophage-based therapeutic products currently under investigation in human clinical trials to combat urinary tract infections. By integrating modern liquid handling robotics, standardized phenotypic assays, and computer vision-based enumeration, we established a platform capable of reproducibly screening large collections of phages against clinically derived bacterial strain panels. This approach enabled systematic assessment of phage-bacteria interactions at scale, facilitating the identification and optimization of phage cocktails with broad in vitro activity. Although bacteriophage therapy has long been investigated as a strategy for treating bacterial infections, few frameworks exist for developing phage combinations in a reproducible and scalable manner. The methods outlined here address this gap and aim to support the broader development of therapeutic assets available to combat antibiotic resistance.

Penke, Taylor J. R. [Locus Biosciences, Morrisvill↗
NASA NTRS1996

Downsizing Visualization Platforms: From Crays to Indigos and Beyond

Despite its increasingly negative connotation in other domains, "downsizing" is a positive trend as it applies to the computer hardware necessary to perform scientific visualization. In this talk, we will consider how the visualization of a particular data set, the Digital Terrain Model (DTM) derived from the Viking Orbiter imagery, has been realized in three distinct projects over the past decade. These examples serve to demonstrate how the vast improvements in computational performance both decrease the cost of such visualization efforts, and permit an increasing level of interactivity. We then consider how even today's graphical systems require the visualization designer to make intelligent choices and trade-offs in database rendering. Finally, we discuss how insights from an understanding of human visual perception can guide these design decisions, and suggest new options for visualization hardware and software.

Kaiser, Mary K.↗
NASA NTRS2005

Revealing Relationships among Relevant Climate Variables with Information Theory

The primary objective of the NASA Earth-Sun Exploration Technology Office is to understand the observed Earth climate variability, thus enabling the determination and prediction of the climate's response to both natural and human-induced forcing. We are currently developing a suite of computational tools that will allow researchers to calculate, from data, a variety of information-theoretic quantities such as mutual information, which can be used to identify relationships among climate variables, and transfer entropy, which indicates the possibility of causal interactions. Our tools estimate these quantities along with their associated error bars, the latter of which is critical for describing the degree of uncertainty in the estimates. This work is based upon optimal binning techniques that we have developed for piecewise-constant, histogram-style models of the underlying density functions. Two useful side benefits have already been discovered. The first allows a researcher to determine whether there exist sufficient data to estimate the underlying probability density. The second permits one to determine an acceptable degree of round-off when compressing data for efficient transfer and storage. We also demonstrate how mutual information and transfer entropy can be applied so as to allow researchers not only to identify relations among climate variables, but also to characterize and quantify their possible causal interactions.

Knuth, Kevin H.↗