Search NASA⌕ Search

SEARCH · Search NASA

Results for “Reality capture”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

A framework to enhance disaster debris estimation with AI and aerial photogrammetry

This study addresses the critical need to enhance disaster preparedness and response, focusing on hurricane impact assessment and debris estimation. Accurate assessments in this context are critical for post-event search-and-rescue (SAR) operations and resource distribution. Recent computing advancements are revealing the potential of unmanned aerial vehicles (UAVs) and artificial intelligence (AI) technologies in collecting data and assisting with post-hurricane reconnaissance. However, the use of AI and UAV photogrammetry for accurate disaster impact analysis remains underexplored. To this end, this study proposes a damage and debris analysis framework harnessing reality capture through aerial imagery and photogrammetry. Within this framework, a region-based neural network is leveraged to detect debris locations in aerial imagery with favorable performance. In a testbed within the Beaumont-Port Arthur region, in Southeast Texas, this study performs 3D reality captures of the built environment. Since the accuracy of the 3D reality capture is of importance in research areas associated with time-sensitive disaster response, we further investigate the optimal 2D aerial imagery overlap ratio required to generate a sufficiently accurate 3D model for disaster impact analysis and debris volume estimation. Results indicate that, in the case of aerial imagery for infrastructure systems, a minimum of 60 % overlap is recommended for damage assessment and debris analysis. In contrast, for flat green areas, a minimum of 50 % overlap is adequate. Overall, for disaster response applications, our study reveals that an overlap ratio between 60 % and 70 % is optimal for achieving a balance between time efficiency and data quality in aerial data collection. Furthermore, these quantitative recommendations are crucial for enabling efficient disaster response efforts. Additionally, our study outcomes will improve disaster impact analysis and facilitating timely and effective response strategies.

Artificial intelligence↗

Automated compatibility checking of prefabricated components using 3D as-built models and BIM

There have been recent efforts to use reality capture technologies to perform remote quality control in construction. However, there is a lack of research efforts in detecting construction incompatibilities in modular construction using reality capture technologies. The construction incompatibilities in modular construction often cause reworks and delays in the project schedule. To address this issue, this paper presents a general compatibility analysis method that propose scanning the modules in manufacturing plant and construction site, and check module-to-module compatibility remotely, prior to the shipment and installation. This study provides three sample module-to-module compatibility scenarios to validate the proposed compatibility analysis. The case study results show that the compatibility analysis method was able to identify the compatibility issues with high accuracy. Lastly, the compatibility analysis method was validated in terms of accuracy and time performance in six scenarios that was defined on the modules.

42 ENGINEERING↗

Virtually Out of This World!

Ames Research Center granted Reality Capture Technologies (RCT), Inc., a license to further develop NASA's Mars Map software platform. The company incorporated NASA#s innovation into software that uses the Virtual Plant Model (VPM)(TM) to structure, modify, and implement the construction sites of industrial facilities, as well as develop, validate, and train operators on procedures. The VPM orchestrates the exchange of information between engineering, production, and business transaction systems. This enables users to simulate, control, and optimize work processes while increasing the reliability of critical business decisions. Engineers can complete the construction process and test various aspects of it in virtual reality before building the actual structure. With virtual access to and simulation of the construction site, project personnel can manage, access control, and respond to changes on complex constructions more effectively. Engineers can also create operating procedures, training, and documentation. Virtual Plant Model(TM) is a trademark of Reality Capture Technologies, Inc.

Source record↗

Virtual reality applications to automated rendezvous and capture

Virtual Reality (VR) is a rapidly developing Human/Computer Interface (HCI) technology. The evolution of high-speed graphics processors and development of specialized anthropomorphic user interface devices, that more fully involve the human senses, have enabled VR technology. Recently, the maturity of this technology has reached a level where it can be used as a tool in a variety of applications. This paper provides an overview of: VR technology, VR activities at Marshall Space Flight Center (MSFC), applications of VR to Automated Rendezvous and Capture (AR&C), and identifies areas of VR technology that requires further development.

Hale, Joseph↗

Scenario Generation for Built Environment Decision Support under Uncertainty: Case Studies of Airflow Modeling and Climate-Resilient Infrastructure System Design

When confronted with unforeseen challenges, practicing informed decision making is crucial for enhancing resilience in the built environment. While scan-to-building information modeling (BIM) is a well-established approach for creating detailed digital representations of physical assets, its application in assessing and improving infrastructure resilience remains underexplored. This study addresses this gap by proposing a novel application of scan-to-BIM, namely, scan-to-BIM-to-digital twin (S-BIM-DT) workflow. By integrating reality capture and digital twin technologies, this workflow creates continuously updated and accurate digital representations of physical assets, enabling the generation of various scenarios. Unlike traditional methods, the S BIM-DT workflow facilitates continuous model refinement, supporting informed resilience strategies. By combining these technologies into a cohesive process, the workflow facilitates decision making under uncertainty, enabling stakeholders to evaluate and respond to various scenarios effectively. We demonstrate the implementation of the S-BIM-DT workflow through two use cases that highlight its capability to enhance resilience at different scales. The first use case involves the Combined Transportation, Emergency, and Communications Center (CTECC) in Austin, Texas. BIM-enriched computational fluid dynamics (CFD) modeling simulates airflow and develops alternative scenarios for optimizing the heating, ventilation, and air conditioning (HVAC) systems. This approach enhances resilience against airborne health threats in a postCOVID context. The second use case focuses on designated areas within Beaumont, Texas, as part of the Southeast Texas Urban Integrated Field Laboratory (SETx-UIFL) research. By developing inundation maps to assess extreme weather events, this modeling aids in preparedness efforts and informs the development of climate-resilient infrastructure in vulnerable neighborhoods. Results indicate that the S-BIM-DT workflow effectively generates scenarios that enhance resilience in the built environment by facilitating informed decision making. Furthermore, this study serves as a bridge between advanced scan-to-BIM methodologies and the practical strategies needed to improve built infrastructure resilience.

Built environment↗

Visualizing Progress

Reality Capture Technologies, Inc. is a spinoff company from Ames Research Center. Offering e-business solutions for optimizing management, design and production processes, RCT uses visual collaboration environments (VCEs) such as those used to prepare the Mars Pathfinder mission.The product, 4-D Reality Framework, allows multiple users from different locations to manage and share data. The insurance industry is one targeted commercial application for this technology.

Source record↗

Using Virtual Reality and Motion Capture as tools for Human Factors Engineering at NASA Marshall Space Flight Center

NASA Marshall Space Flight Center (MSFC) Human Factors Engineering (HFE) Team is implementing virtual reality (VR) and motion capture (MoCap) into HFE analyses of various projects through its Virtual Environments Lab (VEL). VR allows for multiple analyses early in the design process and more opportunities to give design feedback. This tool can be used by engineers in most disciplines to compare design alternatives and is particularly valuable to HFE to give early input during these evaluations. These techniques are being implemented for concept development of Deep Space Habitats (DSH), and work is being done to implement VR for design aspects of the Space Launch System (SLS). VR utilization in the VEL will push the design to be better formulated before mockups are constructed, saving budget and time. The MSFC VEL will continue forward leaning implementation with VR technologies in these and other projects for better models earlier in the design process.

Andrews, Tanya↗

Using Virtual Reality and Motion Capture as tools for Human Factors Engineering at NASA Marshall Space Flight Center

NASA Marshall Space Flight Center (MSFC) Human Factors Engineering (HFE) Team is implementing virtual reality (VR) and motion capture (MoCap) into HFE analyses of various projects through its Virtual Environments Lab (VEL). These techniques are being implemented for concept of development of Deep Space Habitats (DSH) and design and analyses for NASA’s Space Launch System (SLS). VR utilization in the VEL will push the design to be better formulated before mockups are constructed, saving budget and time.

Andrews, Tanya↗

Using Virtual Reality and Motion Capture as Tools for Human Factors Engineering at Nasa Marshall Space Flight Center

MSFC’s Human Factors Engineering (HFE) team is responsible for all worksite analyses performed for the SLS pre-launch integration activities at Kennedy Space Center (KSC). There is a wide variety of tasks associated with pre-launch integration activities and it is important to verify that vehicle integration will be successful early in the design process. The VR work performed by the HFE team at MSFC has allowed fast changing layouts to be analyzed by various departments with minimal impact to cost or schedule. Implementing these methods for SLS allows for VR use in early design cycles, saving time and budget. Utilizing the resulting HFE analyses improves usability and safety. Ultimately, the goal is to provide a safe environment for the technicians assembling the vehicle and the astronaut crew at launch.

Andrews, Tanya↗

Artificial Intelligence Enhancements to Imagery for Space Operations

Philosophy classes still ponder the question asked by Dr. George Berkely, an Anglican Bishop and philosopher in the 1600’s-- “If a tree falls in a forest and no one is around to hear it, does it make a sound?” With that in mind, I ask the following—If a still image or motion imagery from a space mission cannot be found during a search, does it exist? Since the beginning of spaceflight, imagery has been a key form of data collected. Whether for mere curiosity (what does Earth look like from Space?), or for operational reasons (did the solar panel deploy?), or for engineering purposes (what was that object that floated away from the spacecraft?), imagery has been included in space missions. To be useful, though, the image or motion imagery must be accessible and accessed when needed. During the analog era, that typically meant captions and numbers associated with the physical media. With “born digital” imagery, it is possible to add metadata to the image data file. This metadata might include the date and time of capture, mission, camera, exposure data, and similar data fields. Many modern cameras embed some basic metadata into the image file at the moment of capture. The reality, though, is even with today’s born-digital enhancements with embedded metadata at the time of capture, reviewing and cataloging still and motion imagery is very labor intensive. Humans review the imagery for sensitive content (privacy concerns, imagery containing proprietary data/subject matter), and to identify imagery containing crew members or imagery that should be reviewed for engineering or scientific reasons. All this review and manual data entry is very time-consuming. Many improvements in Artificial Intelligence (AI), Machine Learning, and processing power now make it possible to identify persons, objects, motion, color, audio with sensitive content, and other details after or while the imagery is captured.

Rodney Grubbs↗

Aerial and Processed Model Data Representing As-built Conditions in Coastal Port Arthur, Texas in May 2025

This dataset was collected by the Co-Design Team of the Southeast Texas Urban Integrated Field Lab, a research initiative led by the University of Texas at Austin and funded by the U.S. Department of Energy. The broader project focuses on developing climate-resilient design solutions for the Beaumont–Port Arthur region, with more information available at www.setx-uifl.org. Our team conducted aerial surveys of the Port Arthur coastal neighborhood in May 2025, before the start of construction scheduled for Summer 2026. These pre-construction datasets are designed to facilitate comparative analyses, including pre- and post-construction assessments and simulated inundation scenario evaluations. Aerial images were captured using DroneDeploy autonomous flight systems, with imagery processed through the DroneDeploy engine. All original aerial photographs are provided in JPG format and organized in zipped folders by area. The processed data package includes: 3D surface models Orthomosaics Geospatial and topographic mappings Point clouds For guidance on file contents, structure, and recommended usage, please refer to the included README file.

2D mapping↗

Real-time kinematic (RTK) Drone-collected Data and Processed Models of Port Arthur Coastal Neighborhood and Pleasure Island Golf Course, June 2024

The Southeast Texas Urban Integrated field lab’s Co-design team captured aerial photos in the Port Arthur Coastal Neighborhood Community and the Golf Course on Pleasure Island, Texas, in June 2024. Aerial photos taken were through autonomous flight, and models were processed through the DroneDeploy engine. All aerial photos are in .JPG format and contained in zipped files for each area. The processed data package includes 3D models, geospatial data, mappings, and point clouds. Please be aware that DTM, Elevation toolbox, Point Cloud, and Orthomosaic use EPSG: 6588. And 3D Model uses EPSG: 3857.For using these data:- The Adobe Suite gives you great software to open .Tif files.- You can use LASUtility (Windows), ESRI ArcGIS Pro (Windows), or Blaze3D (Windows, Linux) to open a LAS file and view the data it contains.- Open an .OBJ file with a large number of free and commercial applications. Some examples include Microsoft 3D Builder, Apple Preview, Blender, and Autodesk.- You may use ArcGIS, Merkaartor, Blender (with the Google Earth Importer plug-in), Global Mapper, and Marble to open .KML files.- The .tfw world file is a text file used to georeference the GeoTIFF raster images, like the orthomosaic and the DSM. You need suitable software like ArcView to open a .TFW file.This dataset provides researchers with sufficient geometric data and the status quo of the land surface at the locations mentioned above. This dataset will support researchers' decision-making processes under uncertainties.

2D mapping↗

Aerial Data and Processed Models of Port Arthur Coastal Neighborhood and Pleasure Island Golf Course, June 2024

Our Co-design team is from the University of Texas, working on a Department of Energy-funded project focused on the Beaumont-Port Arthur area. As part of this project, we will be developing climate-resilient design solutions for areas of the region. More on www.caee.utexas.edu.We captured aerial photos in the Port Arthur Coastal Neighborhood Community and the Golf Course on Pleasure Island, Texas, in June 2024.Aerial photos taken were through DroneDeploy autonomous flight, and models were processed through the DroneDeploy engine as well. All aerial photos are in .JPG format and contained in zipped files for each area.The processed data package includes 3D models, geospatial data, mappings, and point clouds. Please be aware that DTM, Elevation toolbox, Point cloud, and Orthomosaic use EPSG: 6588. And 3D Model uses EPSG: 3857.For using these data:- The Adobe Suite gives you great software to open .Tif files.- You can use LASUtility (Windows), ESRI ArcGIS Pro (Windows), or Blaze3D (Windows, Linux) to open a LAS file and view the data it contains.- Open an .OBJ file with a large number of free and commercial applications. Some examples include Microsoft 3D Builder, Apple Preview, Blender, and Autodesk.- You may use ArcGIS, Merkaartor, Blender (with the Google Earth Importer plug-in), Global Mapper, and Marble to open .KML files.- The .tfw world file is a text file used to georeference the GeoTIFF raster images, like the orthomosaic and the DSM. You need suitable software like ArcView to open a .TFW file.This dataset provides researchers with sufficient geometric data and the status quo of the land surface at the locations mentioned above. This dataset could streamline researchers' decision-making processes and enhance the design as well.

2D mapping↗

Aerial Captured Data and Processed Models in Beaumont-Port Arthur Region in Feb and Oct, 2023

Our Co-design team is from the University of Texas, working on a Department of Energy-funded project focused on the Beaumont-Port Arthur area. As part of this project, we will be developing climate-resilient design solutions for areas of the region. More on www.caee.utexas.edu.We used a DJI Mavic 2 Pro to capture aerial photos in Beaumont-Port Arthur, TX, in February 2023, including:I. Beaumont Soccer ClubII. Corps’ Port Arthur Resident OfficeIII. Halbouty Pump Station comprises its vicinityIV. Lamar University (Including Exxon Power Plants close to Lamar Univ.)V. MLK Boulevard for aerial images of the industry and the ship channelVI. Salt Water Barrier (include some aerial images about the Big Thicket)Aerial photos taken were through DroneDeploy autonomous flight, and models were processed through the DroneDeploy engine as well. All aerial photos are in .JPG format and contained in zipped files for each location.The processed data package including 3D models, geospatial data, mappings, point clouds, and the animation video of Halbouty Pump Station has various file types:- The Adobe Suite gives you great software to open .Tif files.- You can use LASUtility (Windows), ESRI ArcGIS Pro (Windows), or Blaze3D (Windows, Linux) to open a LAS file and view the data it contains.- Open an .OBJ file with a large number of free and commercial applications. Some examples include Microsoft 3D Builder, Apple Preview, Blender, and Autodesk.- You may use ArcGIS, Merkaartor, Blender (with the Google Earth Importer plug-in), Global Mapper, and Marble to open .KML files.- The .tfw world file is a text file used to georeference the GeoTIFF raster images, like the orthomosaic and the DSM. You need suitable software like ArcView to open a .TFW file.This dataset provides researchers with sufficient geometric data and the status quo of the land surface at the locations mentioned above. This dataset could streamline researchers' decision-making processes and enhance the design as well.In October 2023, we had our follow-up data collection, including:I. Beaumont Soccer ClubII. Shipping and Receiving Center at Lamar UniversityAfter the aerial collection, we obtained aerial photos of those two locations mentioned above, as well as processed data (such as point clouds and models).

2D mapping↗

Application and evaluation of a pattern-based building energy model calibration method using public building datasets

Building performance simulation has been adopted to support decision making in the building life cycle. An essential issue is to ensure a building energy simulation model can capture the reality and complexity of buildings and their systems in both the static characteristics and dynamic operations. Building energy model calibration is a technique that takes various types of measured performance data (e.g., energy use) and tunes key model parameters to match the simulated results with the actual measurements. This study performed an application and evaluation of an automated pattern-based calibration method on commercial building models that were generated based on characteristics of real buildings. A public building dataset that includes high-level building attributes (e.g., building type, vintage, total floor area, number of stories, zip code) of 111 buildings in San Francisco, California, USA, was used to generate building models in EnergyPlus. Monthly level energy use calibrations were then conducted by comparing building model results against the actual buildings' monthly electricity and natural gas consumption. The results showed 57 out of 111 buildings were successfully calibrated against actual buildings, while the remaining buildings showed opportunities for future calibration improvements. Enhancements to the pattern-based model calibration method are identified to expand its use for: (1) central heating, ventilation and air conditioning (HVAC) systems with chillers, (2) space heating and hot water heating with electricity sources, (3) mixed-use building types, and (4) partially occupied buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Atlanta—1991 Household Interview Survey

The Atlanta Regional Commission conducted a Household Travel Survey in 1991 to capture the reality of the locale, including infrastructure improvements—such as new highways, rail, and housing developments—additional households, income, trip chaining, and telecommuting, as well as other typical demographic characteristics. The survey collected demographic, socioeconomic, and travel information on work and non-work travel behavior. Travel data includes trip generation, trip distribution, and modal choice for 3,626 households that completed a travel log.

1Hz data↗

(GO)2-SIM: a GCM-Oriented Ground-Observation Forward-Simulator Framework for Objective Evaluation of Cloud and Precipitation Phase

General circulation model (GCM) evaluation using ground-based observations is complicated by inconsistencies in hydrometeor and phase definitions. Here we describe (GO)2-SIM, a forward simulator designed for objective hydrometeor-phase evaluation, and assess its performance over the North Slope of Alaska using a 1-year GCM simulation. For uncertainty assessment, 18 empirical relationships are used to convert model grid-average hydrometeor (liquid and ice, cloud, and precipitation) water contents to zenith polarimetric micropulse lidar and Ka-band Doppler radar measurements, producing an ensemble of 576 forward-simulation realizations. Sensor limitations are represented in forward space to objectively remove from consideration model grid cells with undetectable hydrometeor mixing ratios, some of which may correspond to numerical noise.Phase classification in forward space is complicated by the inability of sensors to measure ice and liquid signals distinctly. However, signatures exist in lidar–radar space such that thresholds on observables can be objectively estimated and related to hydrometeor phase. The proposed phase-classification technique leads to misclassification in fewer than 8% of hydrometeor-containing grid cells. Such misclassifications arise because, while the radar is capable of detecting mixed-phase conditions, it can mistake water- for ice-dominated layers. However, applying the same classification algorithm to forward-simulated and observed fields should generate hydrometeor-phase statistics with similar uncertainty. Alternatively, choosing to disregard how sensors define hydrometeor phase leads to frequency of occurrence discrepancies of up to 40%. So, while hydrometeor-phase maps determined in forward space are very different from model "reality" they capture the information sensors can provide and thereby enable objective model evaluation.

Lamer, K.↗