Search NASA⌕ Search

SEARCH · Search NASA

Results for “Reality capture”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

A framework to enhance disaster debris estimation with AI and aerial photogrammetry

This study addresses the critical need to enhance disaster preparedness and response, focusing on hurricane impact assessment and debris estimation. Accurate assessments in this context are critical for post-event search-and-rescue (SAR) operations and resource distribution. Recent computing advancements are revealing the potential of unmanned aerial vehicles (UAVs) and artificial intelligence (AI) technologies in collecting data and assisting with post-hurricane reconnaissance. However, the use of AI and UAV photogrammetry for accurate disaster impact analysis remains underexplored. To this end, this study proposes a damage and debris analysis framework harnessing reality capture through aerial imagery and photogrammetry. Within this framework, a region-based neural network is leveraged to detect debris locations in aerial imagery with favorable performance. In a testbed within the Beaumont-Port Arthur region, in Southeast Texas, this study performs 3D reality captures of the built environment. Since the accuracy of the 3D reality capture is of importance in research areas associated with time-sensitive disaster response, we further investigate the optimal 2D aerial imagery overlap ratio required to generate a sufficiently accurate 3D model for disaster impact analysis and debris volume estimation. Results indicate that, in the case of aerial imagery for infrastructure systems, a minimum of 60 % overlap is recommended for damage assessment and debris analysis. In contrast, for flat green areas, a minimum of 50 % overlap is adequate. Overall, for disaster response applications, our study reveals that an overlap ratio between 60 % and 70 % is optimal for achieving a balance between time efficiency and data quality in aerial data collection. Furthermore, these quantitative recommendations are crucial for enabling efficient disaster response efforts. Additionally, our study outcomes will improve disaster impact analysis and facilitating timely and effective response strategies.

Artificial intelligence↗
DOE OSTI2022

Automated compatibility checking of prefabricated components using 3D as-built models and BIM

There have been recent efforts to use reality capture technologies to perform remote quality control in construction. However, there is a lack of research efforts in detecting construction incompatibilities in modular construction using reality capture technologies. The construction incompatibilities in modular construction often cause reworks and delays in the project schedule. To address this issue, this paper presents a general compatibility analysis method that propose scanning the modules in manufacturing plant and construction site, and check module-to-module compatibility remotely, prior to the shipment and installation. This study provides three sample module-to-module compatibility scenarios to validate the proposed compatibility analysis. The case study results show that the compatibility analysis method was able to identify the compatibility issues with high accuracy. Lastly, the compatibility analysis method was validated in terms of accuracy and time performance in six scenarios that was defined on the modules.

42 ENGINEERING↗
DOE OSTI2025

Scenario Generation for Built Environment Decision Support under Uncertainty: Case Studies of Airflow Modeling and Climate-Resilient Infrastructure System Design

When confronted with unforeseen challenges, practicing informed decision making is crucial for enhancing resilience in the built environment. While scan-to-building information modeling (BIM) is a well-established approach for creating detailed digital representations of physical assets, its application in assessing and improving infrastructure resilience remains underexplored. This study addresses this gap by proposing a novel application of scan-to-BIM, namely, scan-to-BIM-to-digital twin (S-BIM-DT) workflow. By integrating reality capture and digital twin technologies, this workflow creates continuously updated and accurate digital representations of physical assets, enabling the generation of various scenarios. Unlike traditional methods, the S BIM-DT workflow facilitates continuous model refinement, supporting informed resilience strategies. By combining these technologies into a cohesive process, the workflow facilitates decision making under uncertainty, enabling stakeholders to evaluate and respond to various scenarios effectively. We demonstrate the implementation of the S-BIM-DT workflow through two use cases that highlight its capability to enhance resilience at different scales. The first use case involves the Combined Transportation, Emergency, and Communications Center (CTECC) in Austin, Texas. BIM-enriched computational fluid dynamics (CFD) modeling simulates airflow and develops alternative scenarios for optimizing the heating, ventilation, and air conditioning (HVAC) systems. This approach enhances resilience against airborne health threats in a postCOVID context. The second use case focuses on designated areas within Beaumont, Texas, as part of the Southeast Texas Urban Integrated Field Laboratory (SETx-UIFL) research. By developing inundation maps to assess extreme weather events, this modeling aids in preparedness efforts and informs the development of climate-resilient infrastructure in vulnerable neighborhoods. Results indicate that the S-BIM-DT workflow effectively generates scenarios that enhance resilience in the built environment by facilitating informed decision making. Furthermore, this study serves as a bridge between advanced scan-to-BIM methodologies and the practical strategies needed to improve built infrastructure resilience.

Built environment↗
DOE OSTI2025

Aerial and Processed Model Data Representing As-built Conditions in Coastal Port Arthur, Texas in May 2025

This dataset was collected by the Co-Design Team of the Southeast Texas Urban Integrated Field Lab, a research initiative led by the University of Texas at Austin and funded by the U.S. Department of Energy. The broader project focuses on developing climate-resilient design solutions for the Beaumont–Port Arthur region, with more information available at www.setx-uifl.org. Our team conducted aerial surveys of the Port Arthur coastal neighborhood in May 2025, before the start of construction scheduled for Summer 2026. These pre-construction datasets are designed to facilitate comparative analyses, including pre- and post-construction assessments and simulated inundation scenario evaluations. Aerial images were captured using DroneDeploy autonomous flight systems, with imagery processed through the DroneDeploy engine. All original aerial photographs are provided in JPG format and organized in zipped folders by area. The processed data package includes: 3D surface models Orthomosaics Geospatial and topographic mappings Point clouds For guidance on file contents, structure, and recommended usage, please refer to the included README file.

2D mapping↗
DOE OSTI2024

Real-time kinematic (RTK) Drone-collected Data and Processed Models of Port Arthur Coastal Neighborhood and Pleasure Island Golf Course, June 2024

The Southeast Texas Urban Integrated field lab’s Co-design team captured aerial photos in the Port Arthur Coastal Neighborhood Community and the Golf Course on Pleasure Island, Texas, in June 2024. Aerial photos taken were through autonomous flight, and models were processed through the DroneDeploy engine. All aerial photos are in .JPG format and contained in zipped files for each area. The processed data package includes 3D models, geospatial data, mappings, and point clouds. Please be aware that DTM, Elevation toolbox, Point Cloud, and Orthomosaic use EPSG: 6588. And 3D Model uses EPSG: 3857.For using these data:- The Adobe Suite gives you great software to open .Tif files.- You can use LASUtility (Windows), ESRI ArcGIS Pro (Windows), or Blaze3D (Windows, Linux) to open a LAS file and view the data it contains.- Open an .OBJ file with a large number of free and commercial applications. Some examples include Microsoft 3D Builder, Apple Preview, Blender, and Autodesk.- You may use ArcGIS, Merkaartor, Blender (with the Google Earth Importer plug-in), Global Mapper, and Marble to open .KML files.- The .tfw world file is a text file used to georeference the GeoTIFF raster images, like the orthomosaic and the DSM. You need suitable software like ArcView to open a .TFW file.This dataset provides researchers with sufficient geometric data and the status quo of the land surface at the locations mentioned above. This dataset will support researchers' decision-making processes under uncertainties.

2D mapping↗
DOE OSTI2024

Aerial Data and Processed Models of Port Arthur Coastal Neighborhood and Pleasure Island Golf Course, June 2024

Our Co-design team is from the University of Texas, working on a Department of Energy-funded project focused on the Beaumont-Port Arthur area. As part of this project, we will be developing climate-resilient design solutions for areas of the region. More on www.caee.utexas.edu.We captured aerial photos in the Port Arthur Coastal Neighborhood Community and the Golf Course on Pleasure Island, Texas, in June 2024.Aerial photos taken were through DroneDeploy autonomous flight, and models were processed through the DroneDeploy engine as well. All aerial photos are in .JPG format and contained in zipped files for each area.The processed data package includes 3D models, geospatial data, mappings, and point clouds. Please be aware that DTM, Elevation toolbox, Point cloud, and Orthomosaic use EPSG: 6588. And 3D Model uses EPSG: 3857.For using these data:- The Adobe Suite gives you great software to open .Tif files.- You can use LASUtility (Windows), ESRI ArcGIS Pro (Windows), or Blaze3D (Windows, Linux) to open a LAS file and view the data it contains.- Open an .OBJ file with a large number of free and commercial applications. Some examples include Microsoft 3D Builder, Apple Preview, Blender, and Autodesk.- You may use ArcGIS, Merkaartor, Blender (with the Google Earth Importer plug-in), Global Mapper, and Marble to open .KML files.- The .tfw world file is a text file used to georeference the GeoTIFF raster images, like the orthomosaic and the DSM. You need suitable software like ArcView to open a .TFW file.This dataset provides researchers with sufficient geometric data and the status quo of the land surface at the locations mentioned above. This dataset could streamline researchers' decision-making processes and enhance the design as well.

2D mapping↗
DOE OSTI2023

Aerial Captured Data and Processed Models in Beaumont-Port Arthur Region in Feb and Oct, 2023

Our Co-design team is from the University of Texas, working on a Department of Energy-funded project focused on the Beaumont-Port Arthur area. As part of this project, we will be developing climate-resilient design solutions for areas of the region. More on www.caee.utexas.edu.We used a DJI Mavic 2 Pro to capture aerial photos in Beaumont-Port Arthur, TX, in February 2023, including:I. Beaumont Soccer ClubII. Corps’ Port Arthur Resident OfficeIII. Halbouty Pump Station comprises its vicinityIV. Lamar University (Including Exxon Power Plants close to Lamar Univ.)V. MLK Boulevard for aerial images of the industry and the ship channelVI. Salt Water Barrier (include some aerial images about the Big Thicket)Aerial photos taken were through DroneDeploy autonomous flight, and models were processed through the DroneDeploy engine as well. All aerial photos are in .JPG format and contained in zipped files for each location.The processed data package including 3D models, geospatial data, mappings, point clouds, and the animation video of Halbouty Pump Station has various file types:- The Adobe Suite gives you great software to open .Tif files.- You can use LASUtility (Windows), ESRI ArcGIS Pro (Windows), or Blaze3D (Windows, Linux) to open a LAS file and view the data it contains.- Open an .OBJ file with a large number of free and commercial applications. Some examples include Microsoft 3D Builder, Apple Preview, Blender, and Autodesk.- You may use ArcGIS, Merkaartor, Blender (with the Google Earth Importer plug-in), Global Mapper, and Marble to open .KML files.- The .tfw world file is a text file used to georeference the GeoTIFF raster images, like the orthomosaic and the DSM. You need suitable software like ArcView to open a .TFW file.This dataset provides researchers with sufficient geometric data and the status quo of the land surface at the locations mentioned above. This dataset could streamline researchers' decision-making processes and enhance the design as well.In October 2023, we had our follow-up data collection, including:I. Beaumont Soccer ClubII. Shipping and Receiving Center at Lamar UniversityAfter the aerial collection, we obtained aerial photos of those two locations mentioned above, as well as processed data (such as point clouds and models).

2D mapping↗
DOE OSTI2022

Application and evaluation of a pattern-based building energy model calibration method using public building datasets

Building performance simulation has been adopted to support decision making in the building life cycle. An essential issue is to ensure a building energy simulation model can capture the reality and complexity of buildings and their systems in both the static characteristics and dynamic operations. Building energy model calibration is a technique that takes various types of measured performance data (e.g., energy use) and tunes key model parameters to match the simulated results with the actual measurements. This study performed an application and evaluation of an automated pattern-based calibration method on commercial building models that were generated based on characteristics of real buildings. A public building dataset that includes high-level building attributes (e.g., building type, vintage, total floor area, number of stories, zip code) of 111 buildings in San Francisco, California, USA, was used to generate building models in EnergyPlus. Monthly level energy use calibrations were then conducted by comparing building model results against the actual buildings' monthly electricity and natural gas consumption. The results showed 57 out of 111 buildings were successfully calibrated against actual buildings, while the remaining buildings showed opportunities for future calibration improvements. Enhancements to the pattern-based model calibration method are identified to expand its use for: (1) central heating, ventilation and air conditioning (HVAC) systems with chillers, (2) space heating and hot water heating with electricity sources, (3) mixed-use building types, and (4) partially occupied buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

Atlanta—1991 Household Interview Survey

The Atlanta Regional Commission conducted a Household Travel Survey in 1991 to capture the reality of the locale, including infrastructure improvements—such as new highways, rail, and housing developments—additional households, income, trip chaining, and telecommuting, as well as other typical demographic characteristics. The survey collected demographic, socioeconomic, and travel information on work and non-work travel behavior. Travel data includes trip generation, trip distribution, and modal choice for 3,626 households that completed a travel log.

1Hz data↗
DOE OSTI2022

Probabilistic Modeling of Commercial Building Occupancy Patterns Using Location-Based Map Data: Preprint

Considering occupancy patterns is crucial to simulate buildings' energy use. Current energy models use inputs that simplify the actual diversity in occupancy into static occupancy patterns and are not able to represent the numerous variations in occupancy patterns between buildings and across different locations. Recently, inferring occupancy schedules from metered electricity consumption data was used to model occupancy in commercial buildings. However, the translation from metered data to occupancy schedules requires many assumptions that might not capture the reality, and the process is hindered by the availability of data from advanced metering infrastructure. With the development of information technologies, occupancy modeling should not be limited to traditional approaches. The prevalence of social networks and location services with real-time user feedback provides publicly accessible data via Maps Application Programming Interfaces (APIs) such as Google Maps, SafeGraph, Mapbox, Foursquare, etc. This paper presents an automated framework for modeling parametric occupancy patterns using such APIs to calibrate commercial district buildings' energy models. This process includes three main steps: data extraction and processing, parametric schedules generation, and schedules integration. We demonstrated this framework in districts where we used maps API to generate more accurate behavioral patterns for operations and electric vehicle charging events. We used these patterns to determine differences in energy use across key sociodemographic and spatial parameters. The presented method has the potential for worldwide applications. Users can utilize this framework to extract data for selected locations of interest to create more realistic behavioral patterns for commercial facilities across different districts.

building energy modeling↗
DOE OSTI2021

MenuFramework

The Menu Framework is a reusable Extended Reality multi-level menu system for the Unity Development Platform. The menu structure is architected for reusability to suit whatever need the developer may have for a multi-level, reusable menu framework. Menu Framework's architecture, GUI, and functionality are based on the paper "Extended Reality for Enhanced Training and Knowledge Capture" (SAND2020-2361C). This tool uses the Microsoft Mixed Reality ToolKit (MRTK) built in functionality to provide a suite of functionalities including bounding box, follow me, minimize, maximize, settings, and help commands. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2021-1507 O

Klein, BrandonThorin↗
DOE OSTI2026

A Simple Panel System to Overcome Interface Challenges for Retrofits: Preprint

Retrofitting buildings is usually an expensive and labor-intensive process. Weatherization measures can improve comfort and energy affordability to some extent, but deep energy retrofits are needed to optimize performance and comfort, and to achieve significant energy cost savings. Barriers to deep energy retrofits include a limited supply of skilled labor, different building types, planning complexity, split incentives, and a long or non-existent ROI horizon. The "Simple Panel System" (SPS) workflow developed and demonstrated in this effort streamlines deep energy retrofits by applying advanced site capture, machine learning, and mixed reality to panelized construction. The result is a one-stop, product-independent solution for rapidly scalable retrofits with the potential to reduce construction time and project costs by 50%. Soft costs are reduced by more than 66%, total costs by more than 50%, and field construction time by more than 50% - not to mention the reduction in construction waste, improvement in working conditions, and the ability to scale without an influx of skilled labor. This paper presents the SPS and the preliminary results and findings from the pilot project.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

An algal-bacterial symbiotic system of carbon fixation using formate as a carbon source

The commercial implementation of algal cultures for efficient capture of CO 2 from fossil-derived flue gases is not a reality yet due to several major challenges, particularly low gas-liquid mass transport efficiency along with loss of productivity due to pests. This study has explored an algal-bacterial symbiotic system to utilize formate as a carbon source. The algal-bacterial assemblage, after a 400-day adaptive evolution using the formate medium, has demonstrated a new capability to assimilate both formate and CO 2 to promote biomass production. The formate tolerant culture system also addresses CO 2 mass transfer limitation under high light conditions. Continuous cultivation of the assemblage on formate led to a carbon capture efficiency of 90 % with a biomass concentration of 0.92 g L -1 and biomass productivity of 0.31 g L -1 day -1 , and the system did not require CO 2 aeration. In addition, 13 C isotope tracing, proteomics, and microbial community analysis reveal a uniquely evolved community for formate utilizations and robust biomass synthesis, in which Chlorella sorokiniana is a dominant phototroph companying with highly diverse bacterial subpopulations. In the presence of formate, evidence has shown that Chlorella is able to form mutualism with formate utilizing bacteria in semi-continuous cultures, leading to a highly effective photomixotrophic metabolism. Furthermore, this study demonstrates a new route of using electrochemical-derived formate to support mutualistic algae-bacteria biorefinery while the formate as an alternative carbon source could repel pests for outdoor algal cultivations.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Systems, devices, and methods for performing augmented reality responsive to monitoring user behavior

Systems, devices, and methods are described for performing augmented reality (AR) to assist user performing a task in an environment. An AR device may be configured to capture real-time data. An AR engine may be configured to monitor user behavior from the real-time data responsive to feature extraction from the real-time data, compare the user behavior to pre-defined work procedures, and generate augmented reality objects to be output by the AR device.

Yoon, SuJong↗
DOE OSTI2025

Radsource Mr: Mixed Reality Planning Tool For Radioactive Recovery

The RadSource MR system leverages Meta Quest 3's advanced mixed reality capabilities to create a comprehensive spatial planning platform for end-of-life sealed radioactive source recovery operations. The application utilizes the Quest 3's high-resolution passthrough cameras and spatial mapping algorithms to generate accurate 3D environmental models. Core technical components include: (1) Real-time spatial measurement algorithms calculating distances, angles, slopes, and surface areas with sub-centimeter accuracy; (2) Virtual object placement system allowing users to position digital representations of recovery equipment (trailers, containment vessels, protective barriers) within the real environment; (3) Voice recording and annotation system for hands-free documentation in protective equipment; (4) 3D mesh capture and storage capabilities for post-operation analysis and regulatory documentation. (5) Procedure documentation is available for viewing in Mixed Reality, providing an innovative and convenient way to access the information during pre-visit and inspection activities. (6) Support for screen capture for the view for real world and virtual objects together to use it later for planning. The system integrates computer vision techniques for environmental understanding, spatial mathematics for precise measurements, and human-computer interaction principles optimized for hazardous environment operations. Data persistence allows teams to save and share planning sessions across multiple stakeholders while maintaining operational security requirements.

Khadka, Rajiv [Idaho National Laboratory (INL), Id↗
DOE OSTI2024

Blue Hydrogen – Not A Bad Idea

In this article, we will look at a technology that can generate hydrogen and power from gasification of a blend of biomass and coal with a “net negative” CO 2 footprint. Let us, however, first take a look at an earlier attempt to gasify coal and generate electric power with pre-combustion CO 2 capture. While the attempt was not exactly a stellar success, at least based on what can be gleaned from superficial press articles, the reality is quite different. This is why it deserves a closer look because its demise was a significant factor (by no means the only one, though) in putting an end to the efforts to maintain coal as a viable option for electricity generation (see the 2007 GTW article on that subject.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2022

Quantum Theory of the Classical: Einselection, Envariance, Quantum Darwinism and Extantons

Core quantum postulates including the superposition principle and the unitarity of evolutions are natural and strikingly simple. I show that—when supplemented with a limited version of predictability (captured in the textbook accounts by the repeatability postulate)—these core postulates can account for all the symptoms of classicality. In particular, both objective classical reality and elusive information about reality arise, via quantum Darwinism, from the quantum substrate. This approach shares with the Relative State Interpretation of Everett the view that collapse of the wavepacket reflects perception of the state of the rest of the Universe relative to the state of observer’s records. However, our “let quantum be quantum” approach poses questions absent in Bohr’s Copenhagen Interpretation that relied on the preexisting classical domain. Thus, one is now forced to seek preferred, predictable, hence effectively classical but ultimately quantum states that allow observers keep reliable records. Without such (i) preferred basis relative states are simply “too relative”, and the ensuing basis ambiguity makes it difficult to identify events (e.g., measurement outcomes). Moreover, universal validity of quantum theory raises the issue of (ii) the origin of Born’s rule, p k =|ψ k | 2 , relating probabilities and amplitudes (that is simply postulated in textbooks). Last not least, even preferred pointer states (defined by einselection—environment—induced superselection)—are still quantum. Therefore, unlike classical states that exist objectively, quantum states of an individual system cannot be found out by an initially ignorant observer through direct measurement without being disrupted. So, to complete the ‘quantum theory of the classical’ one must identify (iii) quantum origin of objective existence and explain how the information about objectively existing states can appear to be essentially inconsequential for them (as it does for states in Newtonian physics) and yet matter in other settings (e.g., thermodynamics). I show how the mathematical structure of quantum theory supplemented by the only uncontroversial measurement postulate (that demands immediate repeatability—hence, predictability) leads to preferred states. These (i) pointer states correspond to measurement outcomes. Their stability is a prerequisite for objective existence of effectively classical states and for events such as quantum jumps. Events at hand, one can now enquire about their probability—the probability of a pointer state (or of a measurement record). I show that the symmetry of entangled states—(ii) entanglement—assisted invariance or envariance—implies Born’s rule. Envariance also accounts for the loss of phase coherence between pointer states. Thus, decoherence can be traced to symmetries of entanglement and understood without its usual tool—reduced density matrices. A simple and manifestly noncircular derivation of p k =|ψ k | 2 follows. Monitoring of the system by its environment in course of decoherence typically leaves behind multiple copies of its pointer states in the environment. Only pointer states can survive decoherence and can spawn such plentiful information-theoretic progeny. This (iii) quantum Darwinism allows observers to use environment as a witness—to find out pointer states indirectly, leaving systems of interest untouched. Quantum Darwinism shows how epistemic and ontic (coexisting in epiontic quantum state) separate into robust objective existence of pointer states and detached information about them, giving rise to extantons—composite objects with system of interest in the core and multiple records of its pointer states in the halo comprising of environment subsystems (e.g., photons) which disseminates that information throughout the Universe.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗