SEARCH · Search NASA

Results for “Reality capture”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Validation of the Community Land Model Version 5 over the Contiguous United States (CONUS) using in situ and remote sensing data sets

The Community Land Model (CLM) is an effective tool to simulate the biophysical and biogeochemical processes and their interactions with the atmosphere. Although CLM Version 5 (CLM5) constitutes various updates in these processes, its performance in simulating energy, water and carbon cycles over the Contiguous United States (CONUS) at scales which land surface changes and hydrometeorological and hydroclimatological applications are more locally relevant is yet to be assessed. In this study, we conducted three simulations at 0.125? during 1979-2018 over the CONUS using different configurations of CLM, namely CLM5-biogeochemistry (CLM5BGC), CLM4.5BGC, and CLM5-satellite phenology (CLM5SP). We validated and compared their simulations against multiple remote-sensed and in-situ datasets. Overall, the parametric and structural updates (e.g., carbon cost for nitrogen uptake, variable soil thickness, dry surface layer) in CLM5 improve its ability in capturing terrestrial biogeochemical dynamics. The low evapotranspiration in CLM5BGC is associated with biases in simulating vegetation phenological characteristics rather than soil water limitations. The mismatch between CLM5BGC-simulated peak leaf area index and reference data can be attributed to CLM5BGC's inability in simulating phenology of trees and grasses. The differences between CLM-simulated irrigation and reference estimates can be attributed to differences between processes represented in models and in reality, and uncertainties in input and validation datasets. Evaluation against observations at small catchments suggest that hydrologic parameters needed to be calibrated to improve simulations of runoff, especially subsurface runoff. Additional efforts are needed to incorporate spatially-distributed plant phenology and physiology parameters and regional-specific agricultural management practices (e.g., planting, harvest).

Cheng, Yanyan↗

DOE OSTI2025

Higher Vortexability: Zero-Field Realization of Higher Landau Levels

The rise of moiré materials has led to experimental realizations of integer and FCIs in small or vanishing magnetic fields. At the same time, a set of minimal conditions sufficient to guarantee an Abelian fractional state in a flat band were identified, namely “ideal" or “vortexable" quantum geometry. Such vortexable bands share essential features with the LLL, while excluding the need for more fine-tuned aspects such as flat Berry curvature. A natural and important generalization is to ask if such conditions can be extended to capture the quantum geometry of higher Landau levels, particularly the first (1LL), where non-Abelian states at ν = 1/2, 2/5 are known to be competitive. The possibility of realizing these states at zero magnetic field, and perhaps even more exotic ones, could become a reality if we could identify the essential structure of the 1LL in Chern bands. In this work, we introduce a precise definition of 1LL quantum geometry, along with a figure of merit that measures how closely a given band approaches the 1LL. Furthermore, periodically strained Bernal graphene is shown to realize such a 1LL structure even in zero magnetic field.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

NASA NTRS2014

Guaranteed Road Network Search with Small Unmanned Aircraft

The use of teams of small unmanned aircraft in real-world rapid-response missions is fast becoming a reality. One such application is search and detection of an evader in urban areas. This paper draws on results in graph-based pursuit-evasion, developing mappings from these abstractions to primitive motions that may be performed by aircraft, to produce search strategies providing guaranteed capture of road-bound targets. The first such strategy is applicable to evaders of arbitrary speed and agility, offering a conservative solution that is insensitive to motion constraints pursuers may possess. This is built upon to generate two strategies for capture of targets having a known speed bound that require searcher teams of much smaller size. The efficacy of these algorithms is demonstrated by evaluation in extensive simulation using realistic vehicle models across a spectrum of environment classes.

unmanned aircraft systems↗

DOE OSTI2026

V-HAMSTeR v1.0.0

V-HAMSTeR is a bioinformatics software tool designed to predict the hosts of viruses directly from genomic sequences. It can be used by researchers to predict animal, prokaryotic, plant, protist or fungal viral hosts including viruses that may be fragmented or discovered in environmental metagenomic datasets. Features & Uses: The software employs a novel dual-stream deep learning architecture that dynamically fuses implicit sequence embeddings from a genomic foundation model with 13 explicit, handcrafted biological features (e.g., coding density and strand switch rates). To ensure maximum reliability, V=HAMSTeR deploys a 5-fold deep ensemble calibrated via Joint Temperature Scaling, providing users with statistically rigorous confidence probabilities. It also features an automated sequence chunking and mean-pooling module to seamlessly process variable-length contigs. Advantages Over Similar Technologies: Existing tools (e.g., IPEV, RNAVirHost) typically rely on either basic k-mers or isolated neural networks. V-HAMSTeR's hybrid architecture captures both broad genomic context and specific biological motifs that standalone foundation models often miss. Furthermore, unlike competitor tools that struggle with incomplete data or exhibit extreme overconfidence, V-HAMSTeR is explicitly benchmarked and mathematically calibrated for fragmented assemblies (1kb–10kb). This makes it uniquely robust, accurate, and trustworthy for the messy reality of real-world environmental viromics.

Grigson, Susie [Lawrence Berkeley National Laborat↗

DOE OSTI2023

Model Inputs, Outputs, and Scripts associated with: “Combined effects of stream hydrology and land use on basin-scale hyporheic zone denitrification in the Columbia River Basin”

This data package is associated with the publication “Combined effects of stream hydrology and land use on basin‐scale hyporheic zone denitrification in the Columbia River Basin”, published in Water Resource Research (Son et al.2022) available at https://doi.org/10.1029/2021WR031131. This data package includes the key model inputs/outputs of the river corridor model for the Columbia River Basin (CRB) and the model source codes used in the manuscript. The model is a carbon-nitrogen-coupled river corridor model (RCM), and the model is used to quantify hyporheic zone (HZ) denitrification at the NHDPLUS stream reach scales. The RCM used in this study combines empirical substrate models derived from observations and three microbially driven reactions, including two-step denitrification and aerobic respiration, are considered within the HZ. The key input data of the model are exchange flux, residence time, and stream solute (dissolved organic carbon (DOC), dissolved oxygen (DO), and nitrate concentrations). These inputs are constant over time and represent long-term averaged values. This study uses the RCM to explore the spatial patterns of HZ denitrification across reaches with different sizes and land use in the CRB. Our main objective is to use the RCM as a virtual reality model, and the machine-learning models as surrogates that encapsulate the complexities of the physics-based model while identifying the importance of different variables that are not evident in the model conceptualization. We do not include a direct comparison of the modeled HZ denitrification and measurements; however, the RCM can capture the overall spatial patterns of the HZ denitrification because the model inputs and its reaction networks are based on well-established theory and a physical-based model. The combination of the model-based predictions and a machine-learning approach (e.g., random forest) is used to improve our understanding of what variables of the model are associated with spatial patterns of the modeled denitrification across reaches with different sizes and land uses, and to develop a proxy model using measurable variables to reproduce the simulated patterns.This dataset contains five folders: (1) model_inputs, (2) model_outputs, (3) Rscripts, (4) figures, and (5) model_codes. It also contains a readme, file level metadata (FLMD), and data dictionary (dd). Please see the FLMD for a list of all the files contained in this data package and descriptions for each. The model_inputs folder contains the model inputs used to drive the model simulations. The model_outputs folder contains key model output files from the river corridor model. The Rscripts folder contains the Rscripts for pre- and post- processing model results. The figures folder contains the raw figures associated with the manuscript. The model_codes folder includes key model source codes/input files. All files are .jpg, .jpeg, .out, .e, .od, .dat, .sub, .F90, .0, .R, .sbx, .cpg, .sbn, .shx, .shp, .dbf, .prj, .tfw, .tif, .xml, .pdf, or .csv.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2001

Finite Element Methods for real-time Haptic Feedback of Soft-Tissue Models in Virtual Reality Simulators

We have applied the linear elastic finite element method to compute haptic force feedback and domain deformations of soft tissue models for use in virtual reality simulators. Our results show that, for virtual object models of high-resolution 3D data (>10,000 nodes), haptic real time computations (>500 Hz) are not currently possible using traditional methods. Current research efforts are focused in the following areas: 1) efficient implementation of fully adaptive multi-resolution methods and 2) multi-resolution methods with specialized basis functions to capture the singularity at the haptic interface (point loading). To achieve real time computations, we propose parallel processing of a Jacobi preconditioned conjugate gradient method applied to a reduced system of equations resulting from surface domain decomposition. This can effectively be achieved using reconfigurable computing systems such as field programmable gate arrays (FPGA), thereby providing a flexible solution that allows for new FPGA implementations as improved algorithms become available. The resulting soft tissue simulation system would meet NASA Virtual Glovebox requirements and, at the same time, provide a generalized simulation engine for any immersive environment application, such as biomedical/surgical procedures or interactive scientific applications.

Frank, Andreas O.↗

NASA NTRSDate not supplied

Implementation of Active Sites in DSMC to Capture Pitting of Oxidizing Carbon Materials

In this work we demonstrate a newly developed capability to capture pitting of carbon fibers in DSMC simulations, specifically using the Stochastic PArallel Rarefied-gas Time-accurate Analyzer (SPARTA) code. State-of-the-art reactive surface models in DSMC compute collision dependent carbon consumption rates (usually through desorption of CO) based on a set of surface reactions that has been derived from molecular beam experiments. The reactivity on each carbon surface element is constant in those models, such that the carbon surface recedes uniformly as a result of ablation. However, it is well known that in reality the carbon surface has locally different reaction rates due to the presence of defects at the atomic scale. These defective sites have a much higher reactivity than the average sites (2-3 orders of magnitude) and are first to react during ablation leading to its removal. This causes all the neighboring atoms to be defective and increase their reactivity, thus leading to the localized carbon removal around these ”active” sites. In this manner, these highly reactive defective sites serve as nucleation sites for the formation and growth of etch pits with potentially detrimental effects on the structural integrity. Recently a detailed surface chemistry framework was developed in SPARTA, capable of incorporating various reaction mechanisms such as adsorption, desorption, Eley-Rideal (ER) and Langmuir-Hinshelwood (LH) mechanisms. Within this framework, we have implemented the capability of a single surface having multiple site sets with different reactivities. Using this feature, we can simulate the presence of active sites on carbon surfaces, whose reactivity is much greater than an average site as a result of defects. We have implemented the active site fraction as a property of surface elements within SPARTA, which is directly proportional to the local reactivity of each surface element. By introducing an initial distribution of the active site fraction across the carbon surface, and propagating it in a manner that mimics the evolution of real reacting carbon surfaces, we are able to capture the formation and growth of etch pits as a result of surface consumption reactions such as oxidation.

DSMC↗

NASA NTRSDate not supplied

Expanding Biological Repository Data Available for Sharing and Knowledge Discovery

Biology has developed next-generation data science and alternative analytical approaches with methodologies which require principal investigator (PI) experimental assay data be re-used. This new approach involves mining multiple datasets at once from various hierarchical organizations of biological complexity, while concurrently evaluating how experimental factors affect endpoints of standard assays. The purpose of the NASA Ames Life Sciences Data Archive (ALSDA) is to collect, curate, and make findable, accessible, interoperable, and reusable (FAIR) all non-human space-relevant biological data. These data include mission metadata, subject metadata, assay metadata (parameters), raw and processed assay data, assay imagery, and subject-experienced telemetry (radiation, temperature, humidity, acoustics, vibrations). ALSDA has transformed to bring current biological repository data and all future collected data into this new scientific data mining reality. It has integrated into the ‘NASA Open Science’ group of projects to facilitate a suite of new tools and workflows to improve data accessibility and reusability by implementing data management plans, automating data submission agreements, and adopting the single-point-of-entry data submission portal, originally developed by NASA GeneLab. These systems required ALSDA to develop science assay configurations for the submission portal, capturing essential assay parameters according to established norms in each sub-field within biology. The submission portal expedites data collection by enhancing ease of PI data submission, providing a user interface and specificity for which data is to be submitted. ALSDA datasets are curated to maintain rich metadata, accuracy of datasets, data transparency, provenance, and additionally ensure data are machine-readable (e.g., R and Python languages). ALSDA integration with GeneLab and its analysis portals enable higher-order physiological-level datasets be mined in conjunction with -omics datasets. As ALSDA physiological-level datasets are published (micro-computed tomography, histology, intraocular pressure, hormonal assays, immunostaining, ultrasonography), the merging of hierarchical organizations of biological complexity from spaceflight will enable new knowledge discovery approaches.

Ryan T Scott↗

NASA NTRSDate not supplied

Implementation of active sites to capture pitting of oxidizing carbon materials in DSMC.

In this work we demonstrate a newly developed capability to capture pitting of carbon fibers in DSMC simulations, specifically using the Stochastic PArallel Rarefied-gas Time-accurate Analyzer (SPARTA) code [1]. State-of-the-art reactive surface models in DSMC compute collision dependent carbon consumption rates (usually through desorption of CO) based on a set of surface reactions that has been derived from molecular beam experiments [2]. The reactivity on each carbon surface element is constant in those models, such that the carbon surface recedes uniformly as a result of ablation. However, it is well known that in reality the carbon surface has locally different reaction rates due to the presence of defects at the atomic scale [3]. These defective sites have a much higher reactivity than the average sites (2-3 orders of magnitude) and are first to react during ablation leading to its removal. This causes all the neighboring atoms to be defective and increase their reactivity, thus leading to the localized carbon removal around these ”active” sites (as shown in Fig. 1). In this manner, these highly reactive defective sites serve as nucleation sites for the formation and growth of etch pits with potentially detrimental effects on the structural integrity. Recently a detailed surface chemistry framework was developed in SPARTA, capable of incorporating various reaction mechanisms such as adsorption, desorption, Eley-Rideal (ER) and Langmuir-Hinshelwood (LH) mechanisms [4]. Within this framework, we have implemented the capability of a single surface having multiple site sets with different reactivities. Using this feature, we can simulate the presence of active sites on carbon surfaces, whose reactivity is much greater than an average site as a result of defects. We have implemented the active site fraction as a property of surface elements within SPARTA, which is directly proportional to the local reactivity of each surface element. By introducing an initial distribution of the active site fraction across the carbon surface, and propagating it in a manner that mimics the evolution of real reacting carbon surfaces, we are able to capture the formation and growth of etch pits as a result of surface consumption reactions such as oxidation.

DSMC↗

NASA NTRSDate not supplied

CFD Validation Study of a Hypersonic Cone-Slice-Flap Variable Geometry Configuration

Model validation is the process of determining the degree of accuracy between physical reality and the model. The result of model validation can either be used to improve the model through calibration or quantify the model-form uncertainty. This work focuses on providing the model-form uncertainty through an area metric for a hypersonic cone-slice-flap variable geometry configuration given uncertainty in both the simulation and experimental data. For a variable geometry, performing uncertainty quantification to capture the model-form uncertainty on every configuration is computationally challenging. This work lays out a procedure that can give an accurate representation of the model-form uncertainty using a small number of high-fidelity runs and many low-fidelity runs on multiple configurations. Running this comparison provides a quantifiable measurement for the accuracy of each turbulence model for this type of design. The high-fidelity CFD solver used was VULCAN-CFD and the low-fidelity results came from Cart3D. The experimental data came from the 20-Inch Mach 6 Tunnel located at NASA Langley Research Center. The present work showed that the turbulence simulation overpredicted the drag and lift coefficient, while underpredicting the pitching moment coefficient. The model-form uncertainty estimate resulted up to a 13.6% change in the total uncertainty for the drag coefficient, up to a 57.4% change in total uncertainty for the lift coefficient, and up to a 100% change in total uncertainty for the pitching moment coefficient.

Laura White↗

DOE OSTI2026

Cluster Dynamics Simulations of Intra-Granular Fission Gas Bubble Size and Pressure Evolution in UO 2

Fission gases such as xenon (Xe) play a critical role in determining the behavior and response of nuclear fuel. Given that Xe has little solubility in UO 2 , it accumulates and forms bubbles, which significantly impact fuel performance. Intra- and inter-granular bubble nucleation and growth can lead to fuel swelling, and once bubbles interconnect at grain boundaries, fission gas can be released into the plenum. At low temperatures, limited uranium vacancy mobility can restrict swelling, therefore causing the bubbles to become highly pressurized. Consequently, this can induce micro-cracking, promote fission gas release (increasing the likelihood of cladding failure), and even lead to fuel pulverization under accident conditions such as a loss of coolant accident. As bubble evolution is strongly influenced by local temperature and fission rate, markedly different behavior occurs across the radial profile of the fuel pellet. Capturing the mechanisms that underpin bubble evolution is therefore important to predict these behaviors in the fuel. Previous models describing important mechanisms informed by lower length scale simulations have been developed under the NEAMS program. These can describe the evolution of a single bubble type (i.e., single value for radius and pressure) at each position in the pellet, for instance using the Centipede cluster dynamic code. However, in reality, a full distribution in bubble sizes and pressures exists within the microstructure at a given position in the pellet. To address this the cluster dynamics code Xolotl, which can predict Xe and vacancy phase space (i.e., bubble distributions) for intra-granular bubbles, has been used before. Prior work benchmarked the Xolotl code against the Centipede cluster dynamics code to ensure compatibility and to verify that mobile defect properties are adequately transferred between the two codes, along with some physics improvements. In this work, we go further by introducing a physics-based set of improvements that will allow us to accurately predict bubble size distributions and internal bubble pressures under representative UO 2 irradiation conditions. The improvements include (i) coupling bubble-defect reaction energies to a virial equation of state (EOS), (ii) including a bubble surface tension contribution, (iii) incorporating radiation-induced re-solution of Xe and vacancies, (iv) enabling pressure-driven dislocation loop punching through an effective emission of interstitial clusters informed by interstitial loop energetics, (v) accounting for radiation induced athermal diffusion of Xe, and (vi) implementing a Booth-type grain boundary sink representation for all mobile defects and defect clusters. After these modifications, we observe good agreement of Xolotl fission gas bubble size and concentration predictions with legacy experimental measurements. Additionally, it allows the distribution of Xe bubble pressures and radius to also be predicted and compared to data produced through the Advanced Fuels Campaign (AFC) program. Here, we have done this by running simulations under conditions similar to the AFC post-irradiation examination (PIE) samples irradiated at North Anna 2 light water reactor (LWR). Our results shows excellent agreement with these experimental measurements.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2020

Validation of the Community Land Model Version 5 over the Contiguous United States (CONUS) using in-situ and remote sensing datasets

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Virtual Reality for Shoot/No-Shoot Decision Training in Law Enforcement: A Literature Review and Research Agenda

Virtual reality (VR) can materially improve “shoot / no-shoot” (SNS) training by giving officers realistic, repeatable practice making high-stakes decisions under pressure. Traditional tools—live-fire ranges and video simulators—build basics, but they cannot adapt to each officer in real time or fully mirror the complexity of the field. VR closes that gap by creating immersive scenarios that are safer, more flexible, easier to scale across units, and able to capture objective performance data. SNS decisions are not just about marksmanship; they rely on perception, judgment, memory, and the ability to hold fire when a threat is uncertain. Effective training therefore needs realism, decision complexity, and branching outcomes that reflect the true consequences of choices. These elements strengthen recognition of hostile intent while reducing false positives and building the self-control required in ambiguous situations. VR brings specific advantages: dynamic environments, full-body interaction, and the ability to measure performance with precision—enabling targeted feedback and better transfer of learning to the street. At the same time, responsible deployment must address scenario quality (credible environments and behaviors), lawful decision models, and user wellbeing (appropriate stress levels, comfort, and safety). Sandia’s VIPER Lab is positioned to lead this work. The team combines human-performance science, AI/ML, and VR/AR development with a deep equipment bench (e.g., omnidirectional treadmill, eye-tracking, haptics, multiple HMDs). This ecosystem supports building and validating next-generation SNS training that is immersive, measurable, and trustworthy. Bottom line: Investment in VR-enabled SNS training that blends evidence-based design with careful validation and legal safeguards is expected to pay off in safer, more consistent decision-making and improved community trust, delivered through training that is practical to deploy at scale.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

NASA NTRS2017

The NASA Augmented/Virtual Reality Lab: The State of the Art at KSC

The NASA Augmented Virtual Reality (AVR) Lab at Kennedy Space Center is dedicated to the investigation of Augmented Reality (AR) and Virtual Reality (VR) technologies, with the goal of determining potential uses of these technologies as human-computer interaction (HCI) devices in an aerospace engineering context. Begun in 2012, the AVR Lab has concentrated on commercially available AR and VR devices that are gaining in popularity and use in a number of fields such as gaming, training, and telepresence. We are working with such devices as the Microsoft Kinect, the Oculus Rift, the Leap Motion, the HTC Vive, motion capture systems, and the Microsoft Hololens. The focus of our work has been on human interaction with the virtual environment, which in turn acts as a communications bridge to remote physical devices and environments which the operator cannot or should not control or experience directly. Particularly in reference to dealing with spacecraft and the oftentimes hazardous environments they inhabit, it is our hope that AR and VR technologies can be utilized to increase human safety and mission success by physically removing humans from those hazardous environments while virtually putting them right in the middle of those environments.

Little, William↗

NASA NTRSDate not supplied

CFD Validation Study of a Hypersonic Cone-Slice-Flap Variable Geometry Configuration

Model validation is the process of determining the degree of accuracy between physical reality and the model. The result of model validation can either be used to improve the model through calibration or quantify the model-form uncertainty. This work focuses on providing the model-form uncertainty through an area metric for a hypersonic cone-slice-flap variable geometry configuration given uncertainty in both the simulation and experimental data. The research here compares two different turbulence models for the simulations. For a variable geometry, performing uncertainty quantification to capture the model-form uncertainty on every configuration is computationally challenging. This work lays out a procedure that can give an accurate representation of the model-form uncertainty using a small number of high-fidelity runs and many low-fidelity runs on multiple configurations. Running this comparison provides a quantifiable measurement for the accuracy of each turbulence model for this type of design. The high-fidelity CFD solver used was VULCAN-CFD and the low-fidelity results came from Cart3D. The experimental data came from the 20-Inch Mach 6 Tunnel located at NASA Langley Research Center. The present work showed that the using both the Spalart and Allamaras and Menter Shear-Stress Transport turbulence models overpredicted the drag and lift coefficient, while underpredicting the pitching moment coefficient. The model-form uncertainty estimate resulted in up to a 13.6% change in the total uncertainty for the drag coefficient, up to a 57.4% change in total uncertainty for the lift coefficient, and up to a 100% change in total uncertainty for the pitching moment coefficient.

Laura M. White↗

DOE OSTI2025

Valuing the Future Electric Grid: A Bid-Based Approach

Energy storage resources (ESRs) and other zero marginal cost (ZMC) resources have unique characteristics that are not fully captured in today’s electricity planning and operations modeling tools. Because the modeling assumptions used in these tools are simplified approximations of how operations and investment decisions occur in the real-world, accurately representing cost and operational characteristics are key for determining how these resources impact price formation. Questions such as—Where should we build new transmission? Will a small modular reactor earn enough revenue to participate in the future electric grid? Is retrofitting a coal plant with carbon capture technology economically feasible?—all require accurate electricity prices, which aren’t available from today’s electricity planning and operations modeling tools. As an example, production cost models (PCMs) are heavily utilized tools that determine the cost and reliability of the electric system. However, as PCMs were developed to help thermal generators manage their fuel inventories, production cost modeling is largely based on fuel prices. Because ESRs do not incur fuel costs, they are often modeled as ZMC resources. In reality, ESRs incur opportunity costs as well as technology-specific (degradation) costs that are non-trivial to calculate but are important for price formation. In this research, we identify options to incorporate more realistic opportunity and degradation costs in ESR bidding algorithms. Expanding available bidding assumptions allows energy system modelers to develop more accurate economic valuations for ESRs, leading to more accurate price formation from leading energy system modeling tools.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS2016

The Virtual Tablet: Virtual Reality as a Control System

In the field of human-computer interaction, Augmented Reality (AR) and Virtual Reality (VR) have been rapidly growing areas of interest and concerted development effort thanks to both private and public research. At NASA, a number of groups have explored the possibilities afforded by AR and VR technology, among which is the IT Advanced Concepts Lab (ITACL). Within ITACL, the AVR (Augmented/Virtual Reality) Lab focuses on VR technology specifically for its use in command and control. Previous work in the AVR lab includes the Natural User Interface (NUI) project and the Virtual Control Panel (VCP) project, which created virtual three-dimensional interfaces that users could interact with while wearing a VR headset thanks to body- and hand-tracking technology. The Virtual Tablet (VT) project attempts to improve on these previous efforts by incorporating a physical surrogate which is mirrored in the virtual environment, mitigating issues with difficulty of visually determining the interface location and lack of tactile feedback discovered in the development of previous efforts. The physical surrogate takes the form of a handheld sheet of acrylic glass with several infrared-range reflective markers and a sensor package attached. Using the sensor package to track orientation and a motion-capture system to track the marker positions, a model of the surrogate is placed in the virtual environment at a position which corresponds with the real-world location relative to the user's VR Head Mounted Display (HMD). A set of control mechanisms is then projected onto the surface of the surrogate such that to the user, immersed in VR, the control interface appears to be attached to the object they are holding. The VT project was taken from an early stage where the sensor package, motion-capture system, and physical surrogate had been constructed or tested individually but not yet combined or incorporated into the virtual environment. My contribution was to combine the pieces of hardware, write software to incorporate each piece of position or orientation data into a coherent description of the object's location in space, place the virtual analogue accordingly, and project the control interface onto it, resulting in a functioning object which has both a physical and a virtual presence. Additionally, the virtual environment was enhanced with two live video feeds from cameras mounted on the robotic device being used as an example target of the virtual interface. The working VT allows users to naturally interact with a control interface with little to no training and without the issues found in previous efforts.

virtual control interface↗

NASA NTRS2007

V-Man Generation for 3-D Real Time Animation

The V-Man project has developed an intuitive authoring and intelligent system to create, animate, control and interact in real-time with a new generation of 3D virtual characters: The V-Men. It combines several innovative algorithms coming from Virtual Reality, Physical Simulation, Computer Vision, Robotics and Artificial Intelligence. Given a high-level task like "walk to that spot" or "get that object", a V-Man generates the complete animation required to accomplish the task. V-Men synthesise motion at runtime according to their environment, their task and their physical parameters, drawing upon its unique set of skills manufactured during the character creation. The key to the system is the automated creation of realistic V-Men, not requiring the expertise of an animator. It is based on real human data captured by 3D static and dynamic body scanners, which is then processed to generate firstly animatable body meshes, secondly 3D garments and finally skinned body meshes.

Nebel, Jean-Christophe↗