Search NASA⌕ Search

SEARCH · Search NASA

Results for “Virtual manipulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Object manipulation in immersive virtual environments: Hand Motion tracking technology and snap-to-fit function

There have been recent efforts to use virtual reality and manipulation to train construction workers and inspection. However, there is a lack of research efforts comparing and evaluating virtual manipulation hardware for construction tasks. Moreover, the current practice of virtual manipulation has limited functionality to guide users with the placement of objects in virtual environments. To address these issues, this paper presents 1) a detailed case study that compares three types of manipulation hardware (image-based, infrared-based, and magnetic-based) for construction applications and 2) a snap-to-fit method that improves the VM through solving limitations of the advanced virtual reality interaction metaphors. The latter enhances the placement process for manipulation by comparing two models (e.g., scan and BIM models) for proper placement in assembly scenarios. Finally, the case study results show that magnetic-based systems outperform others in construction scenarios. Lastly, the snap-to-fit function was validated in terms of accuracy and time performance.

42 ENGINEERING↗
DOE OSTI2026

Re-Evaluating Virtual Reality Manipulation Techniques for Precise Alignment of Complex 3D Objects

Prior research has developed a number of manipulation techniques that can achieve precise object placement in virtual reality, but studies of these techniques typically use simple objects. We conducted a study comparing two existing techniques, (AMP-IT and WISDOM), during alignment of objects with complex geometry to evaluate the potential influence of geometric complexity on performance, usability, workload and preference. Our findings indicate that participants had faster completion times and higher trial completion rates with AMP-IT on high-precision alignment tasks, contrary to earlier findings that used simple objects. Yet WISDOM is still preferred and considered more usable, despite increased workload and poorer performance, exposing participants' willingness to trade objective performance for comfort during use.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Performance Evaluation of Augmented Teleoperation of Contact Manipulation Tasks

At Argonne National Laboratory, an enhanced telerobotic concept has been suggested by providing augmented virtual fixtures for precise and dexterous manipulation. The proposed technology incorporated a human-robot interface that can assist personnel on the processes of Deactivation and Decommissioning in sites of high radiation. It has been implemented on a dual-arm robot system, known as Baxter, by integrating the Robotic Operating System (ROS) with 3D sensors and visual-haptic operator interface. However, what remained before its practical utilization is the capability for precisely placing the virtual fixtures. To this end, the objectives involved camera calibration, which required hardware fabrication and setup, as well as modification and implementation of ROS. The goal of this Research and Development is to develop an augmented-reality- based operator interface for human-inclusive, intelligent, and autonomous robotic system for the Deactivation and Decommissioning (D and D) of radioactive sites. The objectives are to develop: Collaborative Robot; Multi-modal Mixed-Reality Human-Robot Interface; Intelligent and Autonomous Behaviors. In order to achieve this, Baxter's Head-Kinect camera and Left-Hand camera need to be calibrated to overlap the real environment with the simulated environment. Camera calibration, which is crucial for precisely placing the virtual fixtures, was successful after running the simulations. The real and simulated environments overlapped, permitting the utilization of augmented teleoperation and the dexterous manipulation of Baxter for D and D applications in nuclear sites. Future steps: Performance evaluation of augmented teleoperation of contact manipulation tasks: Multiple-Camera 3D Reconstruction and Automation. Oculus Interface: Augmented reality and machine learning for enhanced telerobotic operation (Augmented Tele-autonomy): Machine-learning techniques for complex and flexible autonomous robotic behaviors. Interactive remote operation of robotic systems. Mesh cutting with simulation and real robot.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2022

Cooperative Systems in Presence of Cyber-Attacks: A Unified Framework for Resilient Control and Attack Identification

Here, this paper considers a cooperative control problem in presence of unknown attacks. The attacker aims at destabilizing the consensus dynamics by intercepting the system’s communication network and corrupting its local state feedback. We first revisit the virtual network based resilient control proposed in our previous work and provide a new interpretation and insights into its implementation. Based on these insights, a novel distributed algorithm is presented to detect and identify the compromised communication links. It is shown that it is not possible for the adversary to launch a harmful and stealthy attack by only manipulating the physical states being exchanged via the network. In addition, a new virtual network is proposed which makes it more difficult for the adversary to launch a stealthy attack even though it is also able to manipulate information being exchanged via the virtual network. A numerical example demonstrates that the proposed control framework achieves simultaneously resilient operation and real-time attack identification.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Visualizing biomolecular electrostatics in virtual reality with UnityMol-APBS

The APBS software was developed to solve the equations of continuum electrostatics for large biomolecular assemblages. APBS has enjoyed widespread adoption throughout the biomedical community and is used in numerous applications involving biomolecular structures. However, visualization of complex biomolecular electrostatic properties can be challenging for two-dimensional graphics systems. Therefore, advanced visualization and manipulation capabilities have been incorporated. In particular, APBS tools have been integrated with the UnityMolX virtual reality platform to provide an immersive experience for preparing biomolecular systems for calculations as well as visualizing and comparing calculated results.

electrostatics, molecular visualization, solvation↗
DOE OSTI2021

A VR-based volumetric medical image segmentation and visualization system with natural human interaction

Volume rendering produces informative two-dimensional (2D) images from a 3-dimensional (3D) volume. It highlights the region of interest and facilitates a good comprehension of the entire data set. However, volume rendering faces a few challenges. First, a high-dimensional transfer function is usually required to differentiate the target from its neighboring objects with subtle variance. Unfortunately, designing such a transfer function is a strenuously trial-and-error process. Second, manipulating/visualizing a 3D volume with a traditional 2D input/output device suffers dimensional limitations. To address all the challenges, we design NUI-VR 2 , a natural user interface-enabled volume rendering system in the virtual reality space. NUI-VR 2 marries volume rendering and interactive image segmentation. It transforms the original volume into a probability map with image segmentation. A simple linear transfer function will highlight the target well in the probability map. More importantly, we set the entire image segmentation and volume rendering pipeline in an immersive virtual reality environment with a natural user interface. NUI-VR 2 eliminates the dimensional limitations in manipulating and perceiving 3D volumes and dramatically improves the user experience.

42 ENGINEERING↗
DOE OSTI2024

Dynamically patterning x-ray beam by a femtosecond optical laser

Modern science and technology have greatly benefitted from our ability to precisely manipulate light waves, in both their spatial and temporal degrees of freedom. In the x-ray region, however, spatial control has been virtually static mainly due to stringent requirements for realizing high-performance optical elements. The lack of dynamic spatial control of x-ray beam has prevented researchers from realizing more sophisticated use of the wave field, which has rapidly advanced in the optical region in the past decades. In this study, we propose a practical scheme to dynamically control local x-ray reflectivity of a perfect silicon crystal by a femtosecond optical laser and demonstrate a programmable spatial x-ray modulator. Our modulator aims for spatial manipulation of the x-ray amplitude and is shown to produce arbitrary grayscale patterns with spatial frequencies up to 25 per millimeter. The proposed modulation scheme opens up a platform to enable advanced x-ray sensing and imaging techniques that can fully harness the wave nature of x-rays.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

g-factor engineering with InAsSb alloys toward zero band gap limit

Band gap is known as an effective parameter for tuning the Landé g factor in semiconductors and can be manipulated in a wide range through the bowing effect in ternary alloys. In this work, using the recently developed virtual substrate technique, high-quality InAsSb alloys throughout the whole Sb composition range are fabricated and a large g factor of g≈-90 at the minimum band gap of ~0.1 eV, which is almost twice that in bulk InSb, is found. Further analysis to the zero gap limit reveals a possible gigantic g factor of g≈-200 with a peculiar relativistic Zeeman effect that disperses as the square root of magnetic field. Such a g-factor enhancement toward the narrow gap limit cannot be quantitatively described by the conventional Roth formula, as the orbital interaction effect between the nearly triply degenerated bands becomes the dominant source for the Zeeman splitting. These results may provide insights into realizing large g factors and spin-polarized states in semiconductors and topological materials.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Foreword to special issue: Papers from the 63rd annual meeting of the APS Division of Plasma Physics, November 8–12, 2021

The 63rd annual meeting of the APS Division of Plasma Physics (DPP) was held on November 8–12, 2021 in Pittsburgh at the David Lawrence Convention Center with both a live (in person) component and a virtual component. Following guidance from an APS COVID task force, all in-person attendees were fully vaccinated and masked. More than 800 physicists attended, safely, in-person. With both virtual and on-site participants, discussions were lively, and the research presentations showed unmatched mastery in the modern observation, theory, simulation, and manipulation of plasma. The presentations included four invited review talks, 97 invited talks, four tutorials, and four presentations from this year's prize and award recipients. There were more than 1200 contributed poster presentations and 725 contributed oral presentations. Including both in-person and remote attendees, DPP 2021 had a record of 2232 participants. As a hybrid meeting, in-person presentations of all invited presentations were broadcast live and were accompanied by a Q&A discussion. Contributed oral and poster presentations were prerecorded along with options to schedule in-person discussions on demand. Five mini-conferences were held: “Gatekeeper Workshop: Creating a Diverse, Equitable, and Inclusive Pipeline,” “Collisionless Shocks in Laboratory and Space Plasmas,” “The High Repetition Rate Frontier in High-Energy-Density Physics,” “Measuring and Modeling Plasma Surface Interactions,” and “The Second Mini-Conference on Machine Learning, Data Science and Artificial Intelligence in Plasma Research.” Finally, on the day before the official start of the meeting, an afternoon “for students, by students” included lightning talks, plasma trivia, and an informal occasion to connect with other students, learn how to get the most from the DPP Annual Meeting, and share successful ways to connect with colleagues and advance their professional careers.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Use of Legacy Maritime Protocols Increases Exploitability of Virtual Aids to Navigation

With increased reliance on Virtual Aid(s) to Navigation (VAtoN) - also known as electronic Aid(s) to Navigation (eAtoN), or virtual buoys - a cyber event is likely to cause disruption to international maritime shipping. VAtoN has no physical hardware for visual reference and displays only on a vessel’s Electronic Chart Display Information System (ECDIS) and Automatic Radar Plotting Aid (ARPA); therefore, mariners must rely on the accuracy of the information provided. As VAtoN uses the National Maritime Electronics Association (NMEA) 0183 protocol for both Global Navigation Satellite System (GNSS) and Automatic Identification System (AIS), an insecure protocol that has been proven susceptible to spoofing, denial, and manipulation, the likelihood of a cyber-related event increases substantially.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2023

phenix v. 7.0

SAND2021-6741 O phenix is Sandia's orchestration tool that allows users to quickly deploy, un-deploy, and interact with SCEPTRE ICS environments. phenix is an orchestration tool used for managing the creation, configuration, and deployment of modeling and simulation environments. As an abstraction layer on top of an underlying virtual machine manager called minimega, phenix organizes the network, application, and scenario information for a given deployment. It allows users to create, configure, and deploy experiments in a repeatable and rapid fashion. An application framework provides the flexibility to manipulate an experiment to suit various needs and requirements. phenix also includes a web-based graphical user interface (GUI) where experiments can be created, configured, and interacted with.

Sahakian, Meghan↗
DOE OSTI2022

Deep Generative Models for Materials Discovery and Machine Learning-Accelerated Innovation

Machine learning and artificial intelligence (AI/ML) methods are beginning to have significant impact in chemistry and condensed matter physics. For example, deep learning methods have demonstrated new capabilities for high-throughput virtual screening, and global optimization approaches for inverse design of materials. Recently, a relatively new branch of AI/ML, deep generative models (GMs), provide additional promise as they encode material structure and/or properties into a latent space, and through exploration and manipulation of the latent space can generate new materials. These approaches learn representations of a material structure and its corresponding chemistry or physics to accelerate materials discovery, which differs from traditional AI/ML methods that use statistical and combinatorial screening of existing materials via distinct structure-property relationships. However, application of GMs to inorganic materials has been notably harder than organic molecules because inorganic structure is often more complex to encode. In this work we review recent innovations that have enabled GMs to accelerate inorganic materials discovery. We focus on different representations of material structure, their impact on inverse design strategies using variational autoencoders or generative adversarial networks, and highlight the potential of these approaches for discovering materials with targeted properties needed for technological innovation.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Assessing MP2 frozen natural orbitals in relativistic correlated electronic structure calculations

The high computational scaling with the basis set size and the number of correlated electrons is a bottleneck limiting applications of coupled cluster algorithms, in particular for calculations based on two- or four-component relativistic Hamiltonians, which often employ uncontracted basis sets. This problem may be alleviated by replacing canonical Hartree–Fock virtual orbitals by natural orbitals (NOs). Here, in this paper, we describe the implementation of a module for generating NOs for correlated wavefunctions and, in particular, second order Møller–Plesset perturbation frozen natural orbitals (MP2FNOs) as a component of our novel implementation of relativistic coupled cluster theory for massively parallel architectures [Pototschnig et al. J. Chem. Theory Comput. 17, 5509, (2021)]. Our implementation can manipulate complex or quaternion density matrices, thus allowing for the generation of both Kramers-restricted and Kramers-unrestricted MP2FNOs. Furthermore, NOs are re-expressed in the parent atomic orbital (AO) basis, allowing for generating coupled cluster singles and doubles NOs in the AO basis for further analysis. By investigating the truncation errors of MP2FNOs for both the correlation energy and molecular properties—electric field gradients at the nuclei, electric dipole and quadrupole moments for hydrogen halides HX (X = F–Ts), and parity-violating energy differences for H 2 Z 2 (Z = O–Se)—we find MP2FNOs accelerate the convergence of the correlation energy in a roughly uniform manner across the Periodic Table. It is possible to obtain reliable estimates for both energies and the molecular properties considered with virtual molecular orbital spaces truncated to about half the size of the full spaces.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Immersive Digital Twin Laboratory for Engineering Education (CRADA Final Report)

This project aimed to create an immersive digital twin laboratory that incorporates advanced tracking and visualization capabilities. In collaboration with Fort Lewis College, NREL designed a state-of-the-art physical visualization laboratory, developed a software platform to enable interaction with tracked physical objects in the laboratory, and provided proof-of-concept curricula that included manipulating these tracked objects. The project was initiated to address the growing need for innovative educational tools in engineering education. As renewable energy systems, particularly solar installations, become more complex, there is a pressing need to bridge the gap between theoretical knowledge and practical application. Traditional methods of teaching solar engineering concepts often fall short of providing students with a comprehensive, hands-on understanding. This immersive digital twin laboratory was conceived to fill that gap by creating a safe, non-energized setting where students can interact with augmented solar installation objects, gaining valuable insights into system performance, design, and maintenance. The project utilized extended reality (XR) technologies, including head-mounted displays (HMDs) and a whole-room optical motion tracking system, to connect physical objects with their digital twins in real time. The laboratory was equipped with MagicLeap 2 HMDs, supported by a Vicon Vero 2.2 Optical Tracking System, which provided precise 6-degrees-of-freedom (6-DOF) tracking. We developed a software platform to manage the interaction between the tracked physical objects and their virtual counterparts, enabling real-time data synchronization, object recognition, and virtual overlays. We designed the system to be flexible and extendable, allowing for future integration of additional objects and curriculum. This research advances the field of engineering education by demonstrating the potential of immersive digital twin environments. The laboratory provides a dynamic learning space where students can experiment, collaborate, and learn without the risks associated with live experimentation. The ability to simulate and manipulate solar installation objects under various conditions has broad implications for workforce development, particularly in renewable energy. The project also highlights the economic feasibility of using XR technologies in educational settings, offering a cost-effective solution for institutions looking to enhance their curriculum. By fostering a deeper understanding of solar energy systems, this work contributes to the broader goal of supporting the global energy transition and preparing the next generation of engineers and technicians.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

High-Fidelity Neutronics Model of a Realistic Heat Pipe Microreactor Report

The creation of a digital twin requires two parallel products: a virtual model and a physical asset. This report details the development the high-fidelity reactor physics model of a realistic heat pipe micro reactor for the virtual model. The realistic heat pipe micro reactor provides a generic model that research can utilize to make safeguards considerations. The model will be leveraged for capturing diversion and misuse scenarios expected to take place in a microreactor. A python wrapper has been developed to rapidly explore various acquisition pathways by manipulating the reactor physics model on-the-fly.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Genomes to Structure and Function Workshop Report 2022

The goal of the U.S. Department of Energy (DOE) Biological and Environmental Research (BER) Program is to achieve a predictive understanding of complex biological, earth, and environmental systems with the aim of advancing the nation’s energy and infrastructure security. (https://www.energy.gov/science/ ber/biological-and-environmental-research). To pursue this goal, collaborations among experts in diverse research areas that lead to multidisciplinary projects are indispensable. The roles of DOE’s User Facilities, which offer unique and powerful resources for such research projects, are evolving, and expectations for the facilities are increasing. To respond to Users’ needs, the Joint Genome Institute (JGI) and Environmental Molecular Sciences Laboratory (EMSL) initiated the Facilities Integrating Collaborations for User Science (FICUS) program in 2014. This collaboration has grown into a popular and successful program, advancing more than 100 multidisciplinary projects to date. Similarly, the new interFacility collaborations among the JGI, EMSL, and User resources for BER structural biology and imaging at the Basic Energy Science (BES) Program’s synchrotron and neutron facilities are becoming essential for cutting-edge transdisciplinary science. To further explore the need for the BER research community to combine genomic, functional, and structural approaches to advance their research, an organizing committee was formed to develop and jointly host a 3-part workshop. The committee’s members represented seven DOE National Laboratory User Facilities (Appendix 1 lists the members). The “Genomes to Structure and Function” virtual workshop (see Appendices 2–5) was composed of three sessions. The first session, titled “Molecular Structures” (October 27– 28, 2021), highlighted diverse integrative experimental and computational approaches correlating structural data with sequencing and functional information, as well as predicting protein structures to model complex biological systems. The second session, “Intracellular Organization, and Material Synthesis and Decomposition” (December 15–16, 2021), covered imaging methods for observing, quantifying, and manipulating biosystems. The third session, “Imaging the Rhizosphere and Cellular Organization” (January 26–27, 2022) emphasized advanced and non-invasive imaging techniques applied to plant root-microbe-soil interactions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

KSpaceNavigator (KSN)

Intuitive GUI for manipulating microscope stages, allowing to align crystallographic data with stages, allowing to align crystallographic data with stage coordinates and microscope images. Simulates kinematic diffraction patterns and Kikuchi line patterns. Simulated patterns can be displayed as overlay to actually measured data, allowing manual fingerprinting and angular alignment. Crystallographic data is fed to the program in form of CIF (crystallographic information file) files, which are available from many databases and cover virtually all crystal structure ever reported in any journal. Actual goniometer scales can be linearized by lookup tables, program can be used with any microscope goniometer, double tilt and tilt-rotation type. Software requirements: Win32 platform (XP); Compiler/Version: Borland C++ Builder 5; Type of files: Executable modules; Hardware requirement: PC

Duden, Thomas↗
DOE OSTI2024

Spin-Controllable Dynamics in Defect-Engineered Carbon Nanotubes as Single Photon Emitters: Data-Driven Modeling and Computations

Quantum technologies, such as quantum computing and sensing, require efficient single-photon emission (SPE) sources that operate at room temperature in telecom wavelengths. While several materials can serve as SPE sources, no single platform meets all the criteria for efficiency, ambient operation, and scalability. Single-walled carbon nanotubes (SWCNTs) with covalently attached molecules offer a promising solution. Their SPE can be easily tuned via modifications of the SWCNT's diameter, chirality, and bonded molecules, enabling emission across near-IR to telecom wavelengths at ambient conditions. However, to fully realize the potential of SWCNTs and unlock their quantum capabilities, a deeper understanding of how structural defects from molecular adducts affect their emission and competing photoexcited processes is essential. To address this gap in our knowledge, this project combined quantum chemistry calculations with data-driven methods of cheminformatics (QSAR) and machine learning (ML). The developed computational approaches have provided several design strategies for covalent functionalization of SWCNTs to improve their optical response. The collaboration with Los Alamos National Lab (LANL) enabled direct comparison of computational and experimental data, facilitating method validation. This partnership was enhanced through access to LANL's Center for Integrated Nanotechnologies (CINT) utilizing User Facility Program and summer internships, which provided three NDSU graduate students with hands-on experience at LANL. The outcomes of this project included (1) Advancing the current stage of computational methods in accurate modeling of non-adiabatic spin-dependent photoexcited dynamics and its applicability to nanosystems consisting of thousands of atoms, realized as open-access codes linked to existing DFT-based software; (2) Establishing the relationship between the structure of adducts and SWCNTs and intrinsic excitonic and spin properties of defect states for guiding novel synthetic strategies and experimental probes of chemically functionalized SWCNTs as near-IR emitting materials; (3) Generating virtual libraries of hypothetical functionalized SWCNTs for virtual screening of their chemical structures and optical properties, leveraging new functionalities of SWCNTs; (4) Offering a unique experience for NDSU graduate students that prepared them for future scientific careers related to materials modeling and big data processing. These results were summarized in 12 published journal papers and 3 recently submitted papers. One of a key finding is that the position of defect sites on the SWCNT surface primarily drives the emission redshift (up to 100 meV), while the polarity of the defect-inducing molecules has a much smaller effect (~10 meV). However, the electron-donating or withdrawing properties of a molecule influence selecting reactivity of defect sites. These insights important for optimizing synthetic protocols for desired emissions in SWCNTs. We also revealed that the interaction between two defects at various positions on the SWCNT enhances the redshift and optical activity of states, favoring strong near-IR emission. This suggests that manipulations in defect concentrations is a promising strategy for controlling efficient emission. Mostly important, the defect position was found controllable by the spin states of photoexcited intermediates: Excited aromatic molecules form ortho defects with SWCNTs at their singlet states in the presence of oxygen, while oxygen-free conditions favor para defects via the triplet-state mechanism. Additionally, a heat-activated [2+2] cycloaddition reaction facilitates divalent defect formation with fewer bonding positions that narrows emission bands. These groundbreaking findings have been experimentally validated and significantly advance our understanding of defect chemistry in SWCNTs. Using a novel encoding technique and 3D-MoRSE descriptors, we developed highly accurate ML/QSAR models to predict both the 3D structure and optical properties of SWCNTs with chemical defects. This model enabled the creation of a virtual library of 125,556 structures, providing new insights into the relationship between SWCNT-defect structure and emission.

77 NANOSCIENCE AND NANOTECHNOLOGY↗