Search NASA⌕ Search

Engineering topics

Swanson, Colby

Publications and source records attributed to Swanson, Colby.

Automated Assembly Progress Monitoring in Modular Construction Factories Using Computer Vision-Based Instance Segmentation

Modular construction has recently gained interest as a transformative construction method. In this method, a large portion of the construction is performed inside factories, where processes are fast-paced and interdependent; therefore, any deviation from the schedule can delay the production. Such deviations are frequent in modular factories due to the labor-intensive nature of the tasks. This propagation of delays can be mitigated by continuously monitoring each process; however, current manual monitoring methods are laborious, and recently proposed contact sensor-based methods are intrusive to the work. In addition, recent computer vision-based monitoring methods inside factories are limited to detection algorithms that fail to provide the pixel-level accuracy required for assembly progress monitoring in highly occluded factory scenes, and they require a large number of manual annotations. Therefore, this paper proposes a method to monitor the installation of subassemblies in modular construction factories using mask R-CNN instance segmentation and improves the data efficiency of the model using a copy-paste augmentation method. This method was validated on the CCTV videos captured from a modular construction factory in the US, resulting in a 9% mAP improvement in segmentation.

computer vision↗

Bottleneck Detection in Modular Construction Factories Using Computer Vision

The construction industry is increasingly adopting off-site and modular construction methods due to the advantages offered in terms of safety, quality, and productivity for construction projects. Despite the advantages promised by this method of construction, modular construction factories still rely on manually-intensive work, which can lead to highly variable cycle times. As a result, these factories experience bottlenecks in production that can reduce productivity and cause delays to modular integrated construction projects. To remedy this effect, computer vision-based methods have been proposed to monitor the progress of work in modular construction factories. However, these methods fail to account for changes in the appearance of the modular units during production, they are difficult to adapt to other stations and factories, and they require a significant amount of annotation effort. Due to these drawbacks, this paper proposes a computer vision-based progress monitoring method that is easy to adapt to different stations and factories and relies only on two image annotations per station. In doing so, the Scale-invariant feature transform (SIFT) method is used to identify the presence of modular units at workstations, and the Mask R-CNN deep learning-based method is used to identify active workstations. This information was synthesized using a near real-time data-driven bottleneck identification method suited for assembly lines in modular construction factories. This framework was successfully validated using 420 h of surveillance videos of a production line in a modular construction factory in the U.S., providing 96% accuracy in identifying the occupancy of the workstations and an F-1 Score of 89% in identifying the state of each station on the production line. The extracted active and inactive durations were successfully used via a data-driven bottleneck detection method to detect bottleneck stations inside a modular construction factory. The implementation of this method in factories can lead to continuous and comprehensive monitoring of the production line and prevent delays by timely identification of bottlenecks.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

The Energy in Modular (EMOD) Buildings Method: A Guide to Energy-Efficient Design for Industrialized Construction of Modular Buildings

Industrialized construction has immense potential to address the growing need globally to build and upgrade the building stock to be affordable, energy-efficient, and resilient. It can also help achieve the United States' goal of a 50% reduction in U.S. greenhouse gas (GHG) emissions by 2030. Despite this potential, and the ever-increasing push for electrification and decarbonization of households in the United States, industrialized construction has not yet been leveraged specifically to help address these challenges and accelerate the pathway to meet these goals. The National Renewable Energy Laboratory (NREL) aims to claim this missed opportunity by focusing on delivering affordable, grid-efficient net-zero energy (NZE) modular buildings for underserved communities to ensure an equitable transition to the future of clean energy, accelerate decarbonization of the built environment, and support the development of a high-productivity construction and energy efficiency workforce. The Energy in Modular (EMOD) method is our approach to designing, producing, and delivering affordable, net-zero energy, low-carbon, and healthier buildings at scale. The following energy efficiency strategies are part of the scope of this guide: envelope thermal control, envelope infiltration control, mechanical, electrical, and plumbing systems, smart controls, and solar plus storage. We draw synergies between design for manufacturing and assembly, process optimization, retrofit technologies, and digitization. Our goal is to influence the improvement and production of buildings to increase performance, enhance energy efficiency, and reduce GHG emissions. This guide documents the research and development efforts initiated by a set of design objectives to "modularize" a set of energy efficiency and low-carbon strategies into a housing unit while preserving and enhancing energy efficiency benefits and decarbonization pathways. This guide is intended to serve as a framework for housing developers, housing agencies, architects, energy experts, and process engineers or factory operator personnel who are critical to today's modular builder teams. This guide focuses on specific energy efficiency strategies, decarbonization pathways, and associated processes as part of NREL's research efforts. Stakeholders may substitute other means, methods, and technologies for the ones evaluated in this study.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Identifying Modular Construction Worker Tasks Using Computer Vision

Modular construction is increasingly being seen as an attractive method for delivering building projects due to advantages in safety, quality, and lead-time. Despite these benefits, this method still relies heavily on human labor, which causes variability in factory assembly-line performance that can erode performance benefits of modular construction. Continuous improvement methods can alleviate some of these issues, but they also require continuous monitoring of human workers' performance. Due to limitations of manual time study and automated sensor-based monitoring methods, recently computer vision-based methods have gained momentum in identifying the activities of construction workers from the videos of onsite construction. Therefore, this paper explores the use of computer vision-based human activity recognition techniques to identify and classify worker activities in modular construction videos. Computer vision-based tracking method has been used to track the human workers in each frame, and Resnet-50 network has been used to classify the activity of tracked workers. Evaluation of this framework has achieved higher than 90% accuracy and recall in testing.

computer vision↗

Tracking Volumetric Units in Modular Factories for Automated Progress Monitoring Using Computer Vision

The construction industry is increasingly adopting off-site and prefabricated methods due to advantages offered in safety, quality, and lead time. Applying industrialized methods for plant management in offsite construction factories requires the collection of large volumes of production process data, which is a tedious task when performed manually. Recent attempts to automate this process have relied on sensor-based data collection methods which are susceptible to noise, expensive, and difficult to validate. Computer vision methods, however, enable process data collection from videos without the limitations of the other sensor-based methods. This technology has not been applied for offsite construction except in very few instances and therefore, this study proposes a novel method to reliably collect the production process data using computer vision method in near real-time from widely used surveillance cameras in offsite construction. The proposed method allows the user to annotate the workstations of interest on the video as ground truths and process these areas throughout the entire video to track the units entering and leaving stations, while continuously updating a near real-time schedule of the production line. This framework was validated by implementing on the surveillance videos of the production process of modular home manufacturing in a factory. The results consistently provided 100% accuracy, after denoising, for all the videos processed including 60 h of work for a station. The developed method enables real-time tracking of station performance, which can enable continuous improvement methods for factory management and resource allocation.

computer vision↗