Search NASA⌕ Search

SEARCH · Search NASA

Results for “Reality capture”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Probabilistic Modeling of Commercial Building Occupancy Patterns Using Location-Based Map Data: Preprint

Considering occupancy patterns is crucial to simulate buildings' energy use. Current energy models use inputs that simplify the actual diversity in occupancy into static occupancy patterns and are not able to represent the numerous variations in occupancy patterns between buildings and across different locations. Recently, inferring occupancy schedules from metered electricity consumption data was used to model occupancy in commercial buildings. However, the translation from metered data to occupancy schedules requires many assumptions that might not capture the reality, and the process is hindered by the availability of data from advanced metering infrastructure. With the development of information technologies, occupancy modeling should not be limited to traditional approaches. The prevalence of social networks and location services with real-time user feedback provides publicly accessible data via Maps Application Programming Interfaces (APIs) such as Google Maps, SafeGraph, Mapbox, Foursquare, etc. This paper presents an automated framework for modeling parametric occupancy patterns using such APIs to calibrate commercial district buildings' energy models. This process includes three main steps: data extraction and processing, parametric schedules generation, and schedules integration. We demonstrated this framework in districts where we used maps API to generate more accurate behavioral patterns for operations and electric vehicle charging events. We used these patterns to determine differences in energy use across key sociodemographic and spatial parameters. The presented method has the potential for worldwide applications. Users can utilize this framework to extract data for selected locations of interest to create more realistic behavioral patterns for commercial facilities across different districts.

building energy modeling↗

Human Factors Virtual Analysis Techniques for NASA's Space Launch System Ground Support using MSFC's Virtual Environments Lab (VEL)

Using virtual environments to assess complex large scale human tasks provides timely and cost effective results to evaluate designs and to reduce operational risks during assembly and integration of the Space Launch System (SLS). NASA's Marshall Space Flight Center (MSFC) uses a suite of tools to conduct integrated virtual analysis during the design phase of the SLS Program. Siemens Jack is a simulation tool that allows engineers to analyze human interaction with CAD designs by placing a digital human model into the environment to test different scenarios and assess the design's compliance to human factors requirements. Engineers at MSFC are using Jack in conjunction with motion capture and virtual reality systems in MSFC's Virtual Environments Lab (VEL). The VEL provides additional capability beyond standalone Jack to record and analyze a person performing a planned task to assemble the SLS at Kennedy Space Center (KSC). The VEL integrates Vicon Blade motion capture system, Siemens Jack, Oculus Rift, and other virtual tools to perform human factors assessments. By using motion capture and virtual reality, a more accurate breakdown and understanding of how an operator will perform a task can be gained. By virtual analysis, engineers are able to determine if a specific task is capable of being safely performed by both a 5% (approx. 5ft) female and a 95% (approx. 6'1) male. In addition, the analysis will help identify any tools or other accommodations that may to help complete the task. These assessments are critical for the safety of ground support engineers and keeping launch operations on schedule. Motion capture allows engineers to save and examine human movements on a frame by frame basis, while virtual reality gives the actor (person performing a task in the VEL) an immersive view of the task environment. This presentation will discuss the need of human factors for SLS and the benefits of analyzing tasks in NASA MSFC's VEL.

Searcy, Brittani↗

MenuFramework

The Menu Framework is a reusable Extended Reality multi-level menu system for the Unity Development Platform. The menu structure is architected for reusability to suit whatever need the developer may have for a multi-level, reusable menu framework. Menu Framework's architecture, GUI, and functionality are based on the paper "Extended Reality for Enhanced Training and Knowledge Capture" (SAND2020-2361C). This tool uses the Microsoft Mixed Reality ToolKit (MRTK) built in functionality to provide a suite of functionalities including bounding box, follow me, minimize, maximize, settings, and help commands. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2021-1507 O

Klein, BrandonThorin↗

NASA Marshall Space Flight Center Tools for Human Factors Engineering Assessments for Safe Sls Worksites

NASA Marshall Space Flight Center (MSFC) Human Factors Engineering (HFE) Team is implementing mockup fabrication, virtual reality (VR) and motion capture (MoCap) into HFE analyses of SLS worksites through its Virtual Environments Lab (VEL). MSFC HFE Team is responsible for the Space Launch System (SLS) worksite analyses of the integration activities performed at the Kennedy Space Center (KSC). With a wide variety of tasks, it is important to verify that SLS can be safely integrated at KSC early in the design process. If the ground support crew cannot safely complete the tasks, redesign efforts must be implemented. MSFC HFE is responsible for verification through methods such as drawing inspection, observation of tasks performed, and building physical mockups. There is a need, however, for a faster analysis early in the process that can impact design safety before drawings are finalized. This need is addressed through MSFC’s VEL.

Andrews, Tanya↗

Using Virtual Reality for Worksite Analysis

NASA Marshall Space Flight Center (MSFC) Human Factors Engineering (HFE) Team is implementing virtual reality (VR) and motion capture (MoCap) into HFE analyses of various projects through its Virtual Environments Lab (VEL). This complements the long history of analyses completed using mockups. These techniques are being implemented for; (1) Concept of development of Deep Space Habitats (DSH), (2) Design and analyses for NASA’s Space Launch System (SLS). VR utilization in the VEL will push the design to be better formulated before mockups are constructed, saving budget and time.

Andrews, Tanya↗

Towards Global Simulation of Irrigation in a Land Surface Model: Multiple Cropping and Rice Paddy in Southeast Asia

Agricultural land use significantly influences the surface water and energy balances. Effects of irrigation on land surface states and fluxes include repartitioning of latent and sensible heat fluxes, an increase in net radiation, and an increase in soil moisture and runoff. We are working on representing irrigation practices in continental- to global-scale land surface simulation in NASA's Global Land Data Assimilation System (GLDAS). Because agricultural practices across the nations are diverse, and complex, we are attempting to capture the first-order reality of the regional practices before achieving a global implementation. This study focuses on two issues in Southeast Asia: multiple cropping and rice paddy irrigation systems. We first characterize agricultural practices in the region (i.e., crop types, growing seasons, and irrigation) using the Global data set of monthly irrigated and rainfed crop areas around the year 2000 (MIRCA2000) dataset. Rice paddy extent is identified using remote sensing products. Whether irrigated or rainfed, flooded fields need to be represented and treated explicitly. By incorporating these properties and processes into a physically based land surface model, we are able to quantify the impacts on the simulated states and fluxes.

Beaudoing, Hiroko Kato↗

Robonaut 2 - IVA Experiments On-Board ISS and Development Towards EVA Capability

Robonaut 2 (R2) has completed its fixed base activities on-board the ISS and is scheduled to receive its climbing legs in early 2014. In its continuing line of firsts, the R2 torso finished up its on-orbit activities on its stanchion with the manipulation of space blanket materials and performed multiple tasks under teleoperation control by IVA astronauts. The successful completion of these two IVA experiments is a key step in Robonaut's progression towards an EVA capability. Integration with the legs and climbing inside the ISS will provide another important part of the experience that R2 will need prior to performing tasks on the outside of ISS. In support of these on-orbit activities, R2 has been traversing across handrails in simulated zero-g environments and working with EVA tools and equipment on the ground to determine manipulation strategies for an EVA Robonaut. R2 made significant advances in robotic manipulation of deformable materials in space while working with its softgoods task panel. This panel features quarter turn latches that secure a space blanket to the task panel structure. The space blanket covers two cloth cubes that are attached with Velcro to the structure. R2 was able to open and close the latches, pull back the blanket, and remove the cube underneath. R2 simulated cleaning up an EVA worksite as well, by replacing the cube and reattaching the blanket. In order to interact with the softgoods panel, R2 has both autonomously and with a human in the loop identified and localized these deformable objects. Using stereo color cameras, R2 identified characteristic elements on the softgoods panel then extracted the location and orientation of the object in its field of view using stereo disparity and kinematic transforms. R2 used both vision processing and supervisory control to successfully accomplish this important task. Teleoperation is a key capability for Robonaut's effectiveness as an EVA system. To build proficiency, crewmembers have attempted increasingly difficult tasks using R2 inside the Station. After donning motion capture equipment and a virtual reality visor, Expedition 34/35 flight engineer Tom Marshburn began operations with simple hand movements. Having gained confidence, Marshburn guided R2's arms in a leader-follower exercise with crewmate Chris Cassidy. He was also able to use the hand to grab a tumbling roll of tape, a task only demonstrable in microgravity. Later efforts saw Cassidy handle softgoods through shared control with ground operators, mimicking an activity previously achieved using only autonomy. Robotic climbing through the ISS on handrails requires both precision motion and compliant grasps in order to both position grippers on handrails/seat track and prevent large internal forces. R2 climbs using actively controlled compliance and torque limiting to meet both the precision and softness requirements. During a step, the attached leg is controlled to be strong and stiff in order to maintain precision trajectory tracking. The swing leg is controlled to be stiff but weak to minimize unintentional impact forces while maintaining precision. During a simulated dual limb grasp (as shown in Figure 1), the R2 controller maintains one limb rigid and one limb soft to prevent large internal forces from building up. R2's grippers also use a form of force control to limit grip force while not fully closed on either a handrail or seat track thus limiting unintentional forces on cables/objects that may be present in R2's translational path. The on-board torso R2 safety system relies on a single end-effector velocity limit to prevent potential impact forces from exceeding Station maximum load requirements. R2's mobile configuration required modifications to the velocity limiting safety function due to its large, dynamic inertia. R2's legs maneuver the robot's mass creating configuration dependent, joint-relative inertias. A single all-encompassing velocity limit to cover worst case inertia is prohibitively low. The upgraded R2 control and safety systems solve this problem using momentum limiting, momentum control, and kinetic energy minimization. Momentum and kinetic energy take the robot mass into account relieving low velocity restrictions on low inertia end-effectors while ensuring that the overall mass of R2 is limited from hazardous velocities. The momentum of R2's five safety nodes (each of the four end-effectors and the body) is monitored and compared to a single momentum limit. If any of the five nodes exceeds the safety limit, the motor power is removed and the robot comes to a stop. Momentum control/limiting also provides a simple, reliable method to integrate hand held tools into the safety system by providing the tool mass to the control system thus automatically reducing the allowable velocity of the end-effector with the tool. Work on the ground continues to build the skill set for an EVA Robonaut. Recent experiments (Figure 2) demonstrate how a teleoperator can use R2 to manipulate a tether hook, an important safety precaution on spacewalks. Another task displayed Robonaut's ability to pull back a protective jacket over a hose and search for damage, as well as inspect a quick-disconnect fitting for debris. Demonstrations such as these are indicative of EVA work done on ISS, specifically seen during a series of spacewalks over 2012 and 2013 where astronauts searched for an ammonia leak in one of the external cooling loops. Through experiments both on ISS and on the ground, R2 is evolving and providing the information needed to plan out the upgrades that will make an EVA Robonaut an effective tool. With the addition of legs, R2 will start climbing inside the space station and supply invaluable information on how the climbing strategies and task stabilization techniques must be refined. Ground R2 systems will continue to work with additional EVA tools and equipment in preparation for onboard IVA testing and future EVA applications.

Diftler, Myron↗

A Simple Panel System to Overcome Interface Challenges for Retrofits: Preprint

Retrofitting buildings is usually an expensive and labor-intensive process. Weatherization measures can improve comfort and energy affordability to some extent, but deep energy retrofits are needed to optimize performance and comfort, and to achieve significant energy cost savings. Barriers to deep energy retrofits include a limited supply of skilled labor, different building types, planning complexity, split incentives, and a long or non-existent ROI horizon. The "Simple Panel System" (SPS) workflow developed and demonstrated in this effort streamlines deep energy retrofits by applying advanced site capture, machine learning, and mixed reality to panelized construction. The result is a one-stop, product-independent solution for rapidly scalable retrofits with the potential to reduce construction time and project costs by 50%. Soft costs are reduced by more than 66%, total costs by more than 50%, and field construction time by more than 50% - not to mention the reduction in construction waste, improvement in working conditions, and the ability to scale without an influx of skilled labor. This paper presents the SPS and the preliminary results and findings from the pilot project.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Lunar Surface Mixed Reality and ARGOS Trainer

This Artemis focused Mixed Reality (MR) and ARGOS project extends the current VR/ARGOS CIF project to enhance and add VR/MR capabilities to support analysis, training and risk reduction for lunar surface EVA operations in the extreme South Pole lunar environment. This third year focused on establishing a functional trainer for crew that supports the ingress/egress of a lander as well as surface tasks such as sample collection and tool deployment and operation. Completed enhancements include improving hand tracking, the addition of supporting mixed reality surface operations, and the implementation of a higher fidelity body tracking capability through a motion capture system.

Lunar↗

Research and Development of The Immersive Simulations and Engineering Environment

March of 2018 marked the conclusion of the primary updates to the immersive Simulations and Engineering Environment (iSEE) at Kennedy Space Center (KSC). Many of the problems that had arisen during the previous semester have been addressed and rectified. These included the malfunction to one of the lab's primary routers, the inefficiency of the capture environment, and various interface issues in the analysis software, Jack. This semester was primarily research and development oriented with some focus on implementation of the new hardware and software that was received last semester. The new computers and cameras that arrived sometime during the winter were installed, and the lab received its second operation opportunity. The second operation was a major milestone for the lab, both in terms of what the abilities were and what can be learned from its use. The operation performed was a virtual simulation of a critical task that would occur, if it should be needed, in the Multi Payload Processing Facility. It was done to gather human factors data on its safety and process controls. The technicians were able to come to a number of conclusions about how to perform their task as a result of utilizing iSEE. Another key breakthrough this semester was the introduction to Jack Script, a scripting language built into our analysis software that further extend Jack capabilities. In addition to the aforementioned, many preparations were made for family day, an exposition for KSC families to come out and tour the spaceport. Due to family day being moved to the spring, the video made last fall had to be updated with recent environment changes in preparation for the Family Day demonstrations.

Motion Capture↗

The Implementation of Maximum Likelihood Estimation in Space Launch System Vehicle Design

As NASA’s Space Launch System (SLS) approaches first launch, the design has matured to a point where the manufacturing uncertainty has decreased now that many of the components of the launch vehicle have been manufactured and the flight engines have been successfully tested. Prior to this point, a method was required to qualify and capture the impact of the differences between simulation and reality, as well as any uncertainties in the SLS design. Two primary categories of uncertainty arise during the launch vehicle design process. The first represents flight-day uncertainties including dispersions due to winds and temperatures. These are typically examined by performing a Monte Carlo on 6 Degree of Freedom (6-DOF) simulations. The second category of uncertainties represents any manufacturing variations that are present at the individual component level of the launch vehicle design. These variations are constructed using statistical masses and tend to become better understood and refined as the design cycle matures, finally resulting in the launch vehicle as constructed and tested.

Stein, W. B.↗

An algal-bacterial symbiotic system of carbon fixation using formate as a carbon source

The commercial implementation of algal cultures for efficient capture of CO 2 from fossil-derived flue gases is not a reality yet due to several major challenges, particularly low gas-liquid mass transport efficiency along with loss of productivity due to pests. This study has explored an algal-bacterial symbiotic system to utilize formate as a carbon source. The algal-bacterial assemblage, after a 400-day adaptive evolution using the formate medium, has demonstrated a new capability to assimilate both formate and CO 2 to promote biomass production. The formate tolerant culture system also addresses CO 2 mass transfer limitation under high light conditions. Continuous cultivation of the assemblage on formate led to a carbon capture efficiency of 90 % with a biomass concentration of 0.92 g L -1 and biomass productivity of 0.31 g L -1 day -1 , and the system did not require CO 2 aeration. In addition, 13 C isotope tracing, proteomics, and microbial community analysis reveal a uniquely evolved community for formate utilizations and robust biomass synthesis, in which Chlorella sorokiniana is a dominant phototroph companying with highly diverse bacterial subpopulations. In the presence of formate, evidence has shown that Chlorella is able to form mutualism with formate utilizing bacteria in semi-continuous cultures, leading to a highly effective photomixotrophic metabolism. Furthermore, this study demonstrates a new route of using electrochemical-derived formate to support mutualistic algae-bacteria biorefinery while the formate as an alternative carbon source could repel pests for outdoor algal cultivations.

59 BASIC BIOLOGICAL SCIENCES↗

Integrated Design Systems -Capturing, Reusing and Optimizing Design Methods in New Millenium

An important goal of New Millenium is to research new methods of performing spacecraft and mission design. We have completed the first phase of our effort on how to make design tools such as analysis programs more available. We are now embarking with Stanford University on discovering methods to allow more project history and knowledge to be automatically captured and reused with Ames Research Center on how to use virtual reality to enhance the visualization of new missions before any hardware exists.

New↗

Systems, devices, and methods for performing augmented reality responsive to monitoring user behavior

Systems, devices, and methods are described for performing augmented reality (AR) to assist user performing a task in an environment. An AR device may be configured to capture real-time data. An AR engine may be configured to monitor user behavior from the real-time data responsive to feature extraction from the real-time data, compare the user behavior to pre-defined work procedures, and generate augmented reality objects to be output by the AR device.

Yoon, SuJong↗

Strategies for Identifying Resilient Behavior In Aviation

When we imagine a situation where people fly aircraft and nothing scary happens, we assume it is the system that affords this phenomenon. That is, the overall design is the cause of the success. However, this is not always true. There are many examples of how the presence of a human in the system is the reason for a successful outcome, despite flaws in the system’s design. This resilient behavior is often overlooked and challenging to characterize. In an attempt to identify this phenomenon in a generalizable way, we named and investigated two strategies, as well as identification methods, that exemplify resilient performance: 1) controls; and 2) modifications. First, controls are resilient actions in situations known to be problematic. To capture this, instead of looking at the examples of how the problem became a reality, we look at the examples of how the problem was successfully avoided or controlled. For example, a country road may have a hairpin turn where a higher-than-normal rate of accidents occur. Given that there is a likely system flaw identified, we would look at how the successful drivers navigated the turn. This can be accomplished using current safety reporting systems. Second, modifications are augmentations or changes that people create to fill in the gap between work-as-imagined and work-as-done. This type of resilient performance is directly related to poor design. In aviation, work-as-imagined is often scripted explicitly, so it can be compared to work-as-done through the use of examining system-generated data as well as narrative reports written by the system operators. These two approaches aim to identify resilient human actions to better understand how current systems function, as well as how people contribute to successes that were otherwise unknown.

human factors↗

Radsource Mr: Mixed Reality Planning Tool For Radioactive Recovery

The RadSource MR system leverages Meta Quest 3's advanced mixed reality capabilities to create a comprehensive spatial planning platform for end-of-life sealed radioactive source recovery operations. The application utilizes the Quest 3's high-resolution passthrough cameras and spatial mapping algorithms to generate accurate 3D environmental models. Core technical components include: (1) Real-time spatial measurement algorithms calculating distances, angles, slopes, and surface areas with sub-centimeter accuracy; (2) Virtual object placement system allowing users to position digital representations of recovery equipment (trailers, containment vessels, protective barriers) within the real environment; (3) Voice recording and annotation system for hands-free documentation in protective equipment; (4) 3D mesh capture and storage capabilities for post-operation analysis and regulatory documentation. (5) Procedure documentation is available for viewing in Mixed Reality, providing an innovative and convenient way to access the information during pre-visit and inspection activities. (6) Support for screen capture for the view for real world and virtual objects together to use it later for planning. The system integrates computer vision techniques for environmental understanding, spatial mathematics for precise measurements, and human-computer interaction principles optimized for hazardous environment operations. Data persistence allows teams to save and share planning sessions across multiple stakeholders while maintaining operational security requirements.

Khadka, Rajiv [Idaho National Laboratory (INL), Id↗

The Tropical Upper Troposphere and Lower Stratosphere in the GEOS-2 GCM

The structure of the tropical upper troposphere and lower stratosphere in the GEOS-2 General Circulation Model (GCM) is discussed. The emphasis of this study is on the reality of monthly-mean temperature and water vapor distributions in the model, compared to reasonable observational estimates. It is shown that although the zonal-mean temperature is in good agreement with observations, the GCM supports an excessive zonal asymmetry near the tropopause compared to the ECMWF Reanalyses. In reality there is a QBO-related variability in the zonally averaged lower stratospheric temperature which is not captured by the model. The observed upper tropospheric temperature and humidity fields show variations related to those in the sea surface temperature, which are not incorporated in the GCM; nevertheless, there is some interannual variability in the GCM, indicating a component arising from internal processes. The model is too moist in the middle troposphere (500 hPa) but too dry in the upper troposphere, suggesting that there is too little vertical transport or too much drying in the GCM. Transport into the stratosphere shows a pronounced annual cycle, with drier air entering the tropical stratosphere when the tropopause is coldest in northern winter; while the alternating dry and moist air masses can be traced ascending through the tropical lower stratosphere, the progression of the anomalies is too rapid.

Pawson, S.↗