Search NASA⌕ Search

SEARCH · Search NASA

Results for “virtual environments”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Fused Reality for Enhanced Flight Test Capabilities

The feasibility of using Fused Reality-based simulation technology to enhance flight test capabilities has been investigated. In terms of relevancy to piloted evaluation, there remains no substitute for actual flight tests, even when considering the fidelity and effectiveness of modern ground-based simulators. In addition to real-world cueing (vestibular, visual, aural, environmental, etc.), flight tests provide subtle but key intangibles that cannot be duplicated in a ground-based simulator. There is, however, a cost to be paid for the benefits of flight in terms of budget, mission complexity, and safety, including the need for ground and control-room personnel, additional aircraft, etc. A Fused Reality(tm) (FR) Flight system was developed that allows a virtual environment to be integrated with the test aircraft so that tasks such as aerial refueling, formation flying, or approach and landing can be accomplished without additional aircraft resources or the risk of operating in close proximity to the ground or other aircraft. Furthermore, the dynamic motions of the simulated objects can be directly correlated with the responses of the test aircraft. The FR Flight system will allow real-time observation of, and manual interaction with, the cockpit environment that serves as a frame for the virtual out-the-window scene.

Bachelder, Ed↗

Multi-Objective Reinforcement Learning-Based Deep Neural Networks for Cognitive Space Communications

Future communication subsystems of space exploration missions can potentially benefit from software-defined radios (SDRs) controlled by machine learning algorithms. In this paper, we propose a novel hybrid radio resource allocation management control algorithm that integrates multi-objective reinforcement learning and deep artificial neural networks. The objective is to efficiently manage communications system resources by monitoring performance functions with common dependent variables that result in conflicting goals. The uncertainty in the performance of thousands of different possible combinations of radio parameters makes the trade-off between exploration and exploitation in reinforcement learning (RL) much more challenging for future critical space-based missions. Thus, the system should spend as little time as possible on exploring actions, and whenever it explores an action, it should perform at acceptable levels most of the time. The proposed approach enables on-line learning by interactions with the environment and restricts poor resource allocation performance through virtual environment exploration. Improvements in the multiobjective performance can be achieved via transmitter parameter adaptation on a packet-basis, with poorly predicted performance promptly resulting in rejected decisions. Simulations presented in this work considered the DVB-S2 standard adaptive transmitter parameters and additional ones expected to be present in future adaptive radio systems. Performance results are provided by analysis of the proposed hybrid algorithm when operating across a satellite communication channel from Earth to GEO orbit during clear sky conditions. The proposed approach constitutes part of the core cognitive engine proof-of-concept to be delivered to the NASA Glenn Research Center SCaN Testbed located onboard the International Space Station.

space archtiecture↗

Multi-Objective Reinforcement Learning-based Deep Neural Networks for Cognitive Space Communications

Future communication subsystems of space exploration missions can potentially benefit from software-defined radios (SDRs) controlled by machine learning algorithms. In this paper, we propose a novel hybrid radio resource allocation management control algorithm that integrates multi-objective reinforcement learning and deep artificial neural networks. The objective is to efficiently manage communications system resources by monitoring performance functions with common dependent variables that result in conflicting goals. The uncertainty in the performance of thousands of different possible combinations of radio parameters makes the trade-off between exploration and exploitation in reinforcement learning (RL) much more challenging for future critical space-based missions. Thus, the system should spend as little time as possible on exploring actions, and whenever it explores an action, it should perform at acceptable levels most of the time. The proposed approach enables on-line learning by interactions with the environment and restricts poor resource allocation performance through virtual environment exploration. Improvements in the multiobjective performance can be achieved via transmitter parameter adaptation on a packet-basis, with poorly predicted performance promptly resulting in rejected decisions. Simulations presented in this work considered the DVB-S2 standard adaptive transmitter parameters and additional ones expected to be present in future adaptive radio systems. Performance results are provided by analysis of the proposed hybrid algorithm when operating across a satellite communication channel from Earth to GEO orbit during clear sky conditions. The proposed approach constitutes part of the core cognitive engine proof-of-concept to be delivered to the NASA Glenn Research Center SCaN Testbed located onboard the International Space Station.

space archtiecture↗

Game Development for Engineering Education

Game Development (Process); Game Development Tools; Implementation Tools; Materials Education Game Environment; Virtual Cleanroom; E-learning as game-like environments + CLDT; +CPR Tool.

Morsi, Rasha↗

Assessments of Physiology and Cognition in Hybrid-Reality Environments (APACHE) – A VR “Sandbox” for Planetary Spacewalk Research

NASA is planning to return to the Moon in the mid-2020s as a steppingstone to Mars missions in the 2030s. Spacewalks, or extravehicular activities (EVAs), performed on the Moon and Mars will differ in a variety of ways from those that have been performed in decades past. NASA has identified multiple risks to human health and performance associated with a crewed mission to Mars, especially those associated with exploration EVAs which are expected to be a primary mission activity. Crew may be expected to conduct up to 24 hours of EVA per person per week, where the likelihood of injury and/or mental mistakes are increased compared to ground-based training or current microgravity EVAs and the consequences of which can be catastrophic. Current test environments for exploration EVA research and technology development are large, costly facilities that are limited in their availability or capabilities. Spacesuit testing in a reduced gravity environment such as NASA’s Neutral Buoyancy Laboratory, while a good representation of the crew’s physical workload during exploration EVAs, typically has small datasets and is difficult to integrate physiological sensors or other types of crew performance measures. Meanwhile, scientific field-based testing such as NASA’s Desert Research and Technology Studies offers an operationally relevant environment for exploration EVAs, particularly for cognitive workload, but is also limited by small datasets, lack of a pressurized spacesuit, and obtrusive measures. The limitations of current analogs for exploration EVAs identify a need for a new test environment that can approximate both the physical and cognitive demands associated with exploration EVAs to enable rapid, controlled, and repeatable evaluations of human health and performance risks of exploration missions. In response, the Human Physiology, Performance, Protection, and Operations Laboratory (H-3PO) at NASA Johnson Space Center has developed a hybrid reality exploration EVA analog named the Assessments of Physiology And Cognition in Hybrid-reality Environments (APACHE)[ to address these limitations using a combination of virtual, physical, and hybrid reality techniques. The APACHE facility resides at NASA Johnson Space Center and serves as a large “sandbox” for EVA research and simulation. At its center is a roughly 15x20ft space surrounded by a 14” tall sandbox partially filled with lunar regolith simulant to emulate the physical feeling of walking on a planetary surface and to allow for simulated geology operations. Nearby, a curved passive treadmill (Skillmill Connect, Technogym, Fairfield, NJ) and an omnidirectional treadmill (Infinadeck, Infinadeck, Rocklin, CA) are included to enable exploration of these large virtual environments while also imposing the physical demands, representative timelines, and cognitive burdens required to navigate and traverse these distances during exploration EVA. A 6DOF motion platform is used to simulate rover operations and supports various human performance evaluations and associated risks. Lastly, APACHE can support two extravehicular (EV) crewmembers working in tandem. A computer workstation is located nearby and also supports an intravehicular (IV) crewmember as part of a full mission simulation. The IV crewmember has direct video and audio communication with the EV crew in VR to provide operational and procedural support.

Human Performance↗

A decade of telerobotics in rehabilitation: Demonstrated utility blocked by the high cost of manipulation and the complexity of the user interface

The Stanford/VA Interactive Robotics Laboratory set out in 1978 to test the hypothesis that industrial robotics technology could be applied to serve the manipulation needs of severely impaired individuals. Five generations of hardware, three generations of system software, and over 125 experimental subjects later, we believe that genuine utility is achievable. The experience includes development of over 65 task applications using voiced command, joystick control, natural language command and 3D object designation technology. A brief foray into virtual environments, using flight simulator technology, was instructive. If reality and virtuality come for comparable prices, you cannot beat reality. A detailed review of assistive robot anatomy and the performance specifications needed to achieve cost/beneficial utility will be used to support discussion of the future of rehabilitation telerobotics. Poised on the threshold of commercial viability, but constrained by the high cost of technically adequate manipulators, this worthy application domain flounders temporarily. In the long run, it will be the user interface that governs utility.

Leifer, Larry↗

Exploring the Impact of Compliance With Maneuvering Guidelines for Space Traffic Management

If the current estimate of proposed large constellations is realized, the near-Earth space environment will see more than 50,000 new satellites added to the catalog of resident space objects (RSOs) in the coming decade. This is an order of magnitude increase from the current population and poses new policy challenges as global operators seek to leverage the benefits these new satellite systems provide while also ensuring a sustainable approach to collision avoidance. Various guidelines have been proposed to date to support this effort, including the development of right of way rules to guide how a collision avoidance maneuver should be performed, and how the maneuver burden should be shared between the two satellites involved. However, it is very difficult to evaluate and compare proposed guidelines due to the complex nature of space traffic and the rapidly changing space environment. This study seeks to address this issue by utilizing the Virtual Environment for Space Traffic Analysis (VESTA), a high-fidelity simulation tool that has been developed at Georgia Tech over the past few years with the explicit purpose of evaluating the future of space traffic environment. Using this tool, a sensitivity study is performed that incorporates a likely set of future large constellations and provides metrics on the impact that a select set of proposed maneuvering guidelines would have on operators given realistic variations in spacecraft capabilities (e.g. maneuverability and propulsion capabilities), and other factors (owner-country, public vs. private, etc.). Specifically, this study compares three potential right of way rules: 1) a rule based on maneuverability proposed by the Space Safety Coalition, 2) a rule based on the geometry of the spacecraft rendezvous, and 3) a rule that equally distributes the maneuver burden between two operators, The results highlight general observations on the effectiveness and limitations of each of the proposed maneuvering guidelines. In addition to the choice of right of way rule, success of space traffic management will be significantly impacted by compliance – which operators, or how many operators, comply with the space traffic rules. The findings of this analysis have important implications for future methods that could be pursued to put in place right of way rules. For example, non-binding right of way rules may have variable levels of compliance that differ across actors. The impact of compliance by just one nation, or non-compliance by just one nation, help to demonstrate the impact of ensuring all major space actors coordinate on this effort. Overall, this analysis provides insight into the relative gains in safety (decrease in collision risk) that would likely result from more politically intense efforts to increase the number of countries implementing space traffic management rules.

conjunction assessment↗

The implementation of the Human Exploration Demonstration Project (HEDP), a systems technology testbed

The Human Exploration Demonstration Project (HEDP) is an ongoing task at the NASA's Ames Research Center to address the advanced technology requirements necessary to implement an integrated working and living environment for a planetary surface habitat. The integrated environment consists of life support systems, physiological monitoring of project crew, a virtual environment work station, and centralized data acquisition and habitat systems health monitoring. The HEDP is an integrated technology demonstrator, as well as an initial operational testbed. There are several robotic systems operational in a simulated planetary landscape external to the habitat environment, to provide representative work loads for the crew. This paper describes the evolution of the HEDP from initial concept to operational project; the status of the HEDP after two years; the final facilities composing the HEDP; the project's role as a NASA Ames Research Center systems technology testbed; and the interim demonstration scenarios that have been run to feature the developing technologies in 1993.

Rosen, Robert↗

Community Input on the Need, Scope, and Development Roadmap of a Proposed National Virtual Biosecurity for Bioenergy Crops Center (NVBBCC)

Brookhaven National Laboratory (BNL) was awarded a pilot project in FY22 under the U.S. Department of Energy (DOE) Office of Science Biopreparedness Research Virtual Environment (BRaVE) initiative, to define research priorities, needs, and requirements for a national virtual center devoted to the biosecurity of bioenergy crops. The mission of the proposed center, referred to as the National Virtual Biosecurity for Bioenergy Crop Center (NVBBCC), would be to provide the scientific basis and tools to detect, characterize, model, and mitigate biothreats to bioenergy crops. This function will be essential to ensure the projected increased US reliance over the next few decades on key plant-based energy products, such as biojet fuel. The NVBBCC is envisioned as a distributed, virtual center with multiple national laboratories at its core to maximize the use of existing unique facilities and expertise across the DOE complex. A major goal of the pilot project was to develop a roadmap for establishing NVBBCC through a series of meetings to gather community input. A total of about 150 individuals, drawn from DOE laboratories, the USDA, academia, NIH, DHS and the private sector participated in six planning meetings held in FY23. Four of the meetings were focused on specific research topics (disease detection, dispersion and disease propagation, biomolecular characterization of plant-pathogen interaction, and mitigation strategies). These four meetings were followed by a meeting that focused on computational needs to support collaborative, data-intensive research within a distributed center as well as workforce development. A final meeting focused on establishing and maintaining preparedness within NVBBCC to respond to an emerging disease within bioenergy crops and how it would collaborate and coordinate with USDA and DHS.

09 BIOMASS FUELS↗

The development of the human exploration demonstration project (HEDP), a planetary systems testbed

The Human Exploration Demonstration Project (HEDP) is an ongoing task at the National Aeronautics and Space Administration's Ames Research Center to address the advanced technology requirements necessary to implement an integrated working and living environment for a planetary surface habitat. The integrated environment will consist of life support systems, physiological monitoring of project crew, a virtual environment workstation, and centralized data acquisition and habitat systems health monitoring. There will be several robotic systems on a simulated planetary landscape external to the habitat environment to provide representative work loads for the crew. This paper describes the status of the HEDP after one year, the major facilities composing the HEDP, the project's role as an Ames Research Center testbed, and the types of demonstration scenarios that will be run to showcase the technologies.

Chevers, Edward S.↗

Electronic Visualization Laboratory's 50th Anniversary Retrospective: Look to the Future, Build on the Past

September 2023 marks the 50th anniversary of the Electronic Visualization Laboratory (EVL) at University of Illinois Chicago (UIC). EVL's introduction of the CAVE Automatic Virtual Environment in 1992, the first widely replicated, projection-based, walk-in, virtual-reality (VR) system in the world, put EVL at the forefront of collaborative, immersive data exploration and analytics. However, the journey did not begin then. Since its founding in 1973, EVL has been developing tools and techniques for real-time, interactive visualizations—pillars of VR. But EVL's culture is also relevant to its successes, as it has always been an interdisciplinary lab that fosters teamwork, where each person's expertise contributes to the development of the necessary tools, hardware, system software, applications, and human interface models to solve problems. Over the years, as multidisciplinary collaborations evolved and advanced scientific instruments and data resources were distributed globally, the need to access and share data and visualizations while working with colleagues, local and remote, synchronous and asynchronous, also became important fields of study. This paper is a retrospective of EVL's past 50 years that surveys the many networked, immersive, collaborative visualization and VR systems and applications it developed and deployed, as well as lessons learned and future plans.

Johnson, Andrew E.↗

Postural Control Disturbances Produced By Exposure to HMD and Dome Vr Systems

Two critical and unresolved human factors issues in VR systems are: 1) potential "cybersickness", a form of motion sickness which is experienced in virtual worlds, and 2) maladaptive sensorimotor performance following exposure to VR systems. Interestingly, these aftereffects are often quite similar to adaptive sensorimotor responses observed in astronauts during and/or following space flight. Most astronauts and cosmonauts experience perceptual and sensorimotor disturbances during and following space flight. All astronauts exhibit decrements in postural control following space flight. It has been suggested that training in virtual reality (VR) may be an effective countermeasure for minimizing perceptual and/or sensorimotor disturbances. People adapt to consistent, sustained alterations of sensory input such as those produced by microgravity, and experimentally-produced stimulus rearrangements (e.g., reversing prisms, magnifying lenses, flight simulators, and VR systems). Adaptation is revealed by aftereffects including perceptual disturbances and sensorimotor control disturbances. The purpose of the current study was to compare disturbances in postural control produced by dome and head-mounted virtual environment displays. Individuals recovered from motion sickness and the detrimental effects of exposure to virtual reality on postural control within one hour. Sickness severity and initial decrements in postural equilibrium decreases over days, which suggests that subjects become dual-adapted over time. These findings provide some direction for developing training schedules for VR users that facilitate adaptation, and address safety concerns about aftereffects.

Harm, D. L.↗

Surface matching for correlation of virtual models: Theory and application

Virtual reality can enable a robot user to off line generate and test in a virtual environment a sequence of operations to be executed by the robot in an assembly cell. Virtual models of objects are to be correlated to the real entities they represent by means of a suitable transformation. A solution to the correlation problem, which is basically a problem of 3-dimensional adjusting, has been found exploiting the surface matching theory. An iterative algorithm has been developed, which matches the geometric surface representing the shape of the virtual model of an object, with a set of points measured on the surface in the real world. A peculiar feature of the algorithm is to work also if there is no one-to-one correspondence between the measured points and those representing the surface model. Furthermore the problem of avoiding convergence to local minima is solved, by defining a starting point of states ensuring convergence to the global minimum. The developed algorithm has been tested by simulation. Finally, this paper proposes a specific application, i.e., correlating a robot cell, equipped for biomedical use with its virtual representation.

Caracciolo, Roberto↗

Effects of characteristics of image quality in an immersive environment

Image quality issues such as field of view (FOV) and resolution are important for evaluating "presence" and simulator sickness (SS) in virtual environments (VEs). This research examined effects on postural stability of varying FOV, image resolution, and scene content in an immersive visual display. Two different scenes (a photograph of a fountain and a simple radial pattern) at two different resolutions were tested using six FOVs (30, 60, 90, 120, 150, and 180 deg.). Both postural stability, recorded by force plates, and subjective difficulty ratings varied as a function of FOV, scene content, and image resolution. Subjects exhibited more balance disturbance and reported more difficulty in maintaining posture in the wide-FOV, high-resolution, and natural scene conditions.

Non-NASA Center↗

A virtual work space for both hands manipulation with coherency between kinesthetic and visual sensation

This paper describes the construction of a virtual work space for tasks performed by two handed manipulation. We intend to provide a virtual environment that encourages users to accomplish tasks as they usually act in a real environment. Our approach uses a three dimensional spatial interface device that allows the user to handle virtual objects by hand and be able to feel some physical properties such as contact, weight, etc. We investigated suitable conditions for constructing our virtual work space by simulating some basic assembly work, a face and fit task. We then selected the conditions under which the subjects felt most comfortable in performing this task and set up our virtual work space. Finally, we verified the possibility of performing more complex tasks in this virtual work space by providing simple virtual models and then let the subjects create new models by assembling these components. The subjects can naturally perform assembly operations and accomplish the task. Our evaluation shows that this virtual work space has the potential to be used for performing tasks that require two-handed manipulation or cooperation between both hands in a natural manner.

Ishii, Masahiro↗

Destabilizing effects of visual environment motions simulating eye movements or head movements

In the present paper, we explore effects on the human of exposure to a visual virtual environment which has been enslaved to simulate the human user's head movements or eye movements. Specifically, we have studied the capacity of our experimental subjects to maintain stable spatial orientation in the context of moving their entire visible surroundings by using the parameters of the subjects' natural movements. Our index of the subjects' spatial orientation was the extent of involuntary sways of the body while attempting to stand still, as measured by translations and rotations of the head. We also observed, informally, their symptoms of motion sickness.

White, Keith D.↗

Evaluation Methodologies for Early Conceptual Design Using Virtual Reality and Physical Test Environments

In this study, human factor design engineers wanted to know, by using subject matter experts (SMEs), if there would be any differences in testing low-fidelity conceptual designs in a physical environment compared to a digital/virtual one. Results indicated that when testing a design concept at this early stage, a high correlation between the two environments exists, meaning SMEs found little to no difference when evaluating a design in either a physical or a digital/virtual environment. There are advantages and limitations to both environments. The virtual world gave the experts a better sense of the microgravity space environment and the relationships of space and human presence that are difficult to simulate in a 1-g physical environment. However, the interaction between human and mechanics is better enhanced in the physical world compared to the virtual world. These advantages and limitations of each environment are important; however, cost is also an important consideration when early design concepts are being used. With the cost analysis of materials, hardware, and labor conducting for this study, virtual reality showed a 68% decrease in cost over the physical mock-up build. Thus, taking all aspects of the study into consideration, at this early design life cycle phase, virtual reality shows great promise as an evaluation environment for testing early design concepts that will cost less, give more options, and increase designer’s time to design.

Harry L. Litaker Jr↗