Abstract
Today, automated techniques for the update of as-built Building Information Models (BIM) make use of offline algorithms restricting the update frequency to an extent where continuous monitoring becomes nearly impossible. To address this problem, we propose a new method for robotic monitoring that updates an as-built BIM in real-time by solving a Simultaneous Localization and Mapping (SLAM) problem where the map is represented as a collection of elements from the as-planned BIM. The suggested approach is based on the Rao-Blackwellized Particle Filter (RBPF) which enables explicit injection of prior knowledge from the building’s construction schedule, i.e., from a 4D BIM, or its elements’ spatial relations. In the methods section we describe the benefits of using an exact inverse sensor model that provides a measure for the existence probability of elements while considering the entire probabilistic existence belief map. We continue by outlining robustification techniques that include both geometrical and temporal dimensions and present how we account for common pose and shape mistakes in constructed elements. Additionally, we show that our method reduces to the standard Monte Carlo Localization (MCL) in known areas. We conclude by presenting simulation results of the proposed method and comparing it to adjacent alternatives.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Borrmann, A., König, M., Koch, C., Beetz, J.: Building information modeling: Technology foundations and industry practice. (2018). https://doi.org/10.1007/978-3-319-92862-3
Volk, R., Stengel, J., Schultmann, F.: Building information modeling (BIM) for existing buildings - literature review and future needs. Autom. Constr. 38, 109–127 (2014). https://doi.org/10.1016/j.autcon.2013.10.023
Rehman, M.S.U., Shafiq, M.: Automated Construction Progress Monitoring - Industry Perspective. In: CITC-12 (2022)
Omar, T., Nehdi, M.L.: Data acquisition technologies for construction progress tracking. Autom. Constr. 70, 143–155 (2016). https://doi.org/10.1016/j.autcon.2016.06.016
Kim, P., Park, J., Cho, Y.K., Kang, J.: UAV-assisted autonomous mobile robot navigation for as-is 3D data collection and registration in cluttered environments. Autom. Constr. 106, no. July, 102918 (2019). https://doi.org/10.1016/j.autcon.2019.102918
Prieto, S.A., de Soto, G.B., Adán, A.: A methodology to monitor construction progress using autonomous robots. In: 37th International Symposium on Automation and Robotics in Construction (ISARC 2020), pp. 1515–1522 (2020). https://doi.org/10.22260/ISARC2020/0210
Hamledari, H., Sajedi, S., McCabe, B., Fischer, M.: Automation of Inspection Mission Planning Using 4D BIMs and in Support of Unmanned Aerial Vehicle–Based Data Collection. J. Constr. Eng. Manag. 147(3), (2021). https://doi.org/10.1061/(asce)co.1943-7862.0001995
Jung, J., Yoon, S., Ju, S., Heo, J.: Development of kinematic 3D laser scanning system for indoor mapping and as-built BIM using constrained SLAM. Sensors. 15(10), 26430–26456 (2015). https://doi.org/10.3390/s151026430
Gao, T., Akinci, B., Ergan, S., Garrett, J.H.: Constructing as-is BIMs from progressive scan data. In: Proceedings of the 29th ISARC (2012, no. 11). https://doi.org/10.4017/gt.2012.11.02.500.00
Turkan, Y., Bosche, F., Haas, C.T., Haas, R.: Automated progress tracking using 4D schedule and 3D sensing technologies. Autom. Constr. 22, 414–421 (2012). https://doi.org/10.1016/j.autcon.2011.10.003
Kim, C., Kim, C., Son, H.: Automated construction progress measurement using a 4D building information model and 3D data. Autom. Constr. 31, 75–82 (2013). https://doi.org/10.1016/j.autcon.2012.11.041
Durrant-Whyte, H., Bailey, T.: Simultaneous localization and mapping: part I. IEEE Robot. Autom. Mag. 13(2), 99–108 (2006). https://doi.org/10.1109/MRA.2006.1638022
Popović, G., Oršulić, J., Miklić, D., Bogdan, S.: Rao-blackwellized particle filter SLAM with prior map: an experimental evaluation. In: Advances in Intelligent Systems and Computing, vol. 693, pp. 14–25. Springer Verlag (2018). https://doi.org/10.1007/978-3-319-70833-1_2
G. Grisetti, C. Stachniss, and W. Burgard, “Improved techniques for grid mapping with Rao-Blackwellized particle filters,” IEEE Trans. Robot., vol. 23, no. 1, pp. 34–46, Feb. 2007, https://doi.org/10.1109/TRO.2006.889486
Kaufman, E., Lee, T., Ai, Z., Moskowitz, I.S.: Bayesian occupancy grid mapping via an exact inverse sensor model. In: Proceedings of the American Control Conference, Jul. 2016, pp. 5709–5715. https://doi.org/10.1109/ACC.2016.7526564
E. Kaufman, K. Takami, T. Lee, and Z. Ai, “Autonomous exploration with exact inverse sensor models,” Journal of Intelligent and Robotic Systems: Theory and Applications, vol. 92, no. 3–4, pp. 435–452, Dec. 2018, https://doi.org/10.1007/s10846-017-0710-7
Stachniss, C.: Robotic Mapping and Exploration, vol. 55. Springer, Freiburg, Germany (2009). https://doi.org/10.1007/978-3-642-01097-2
Rausch, C., Haas, C.: Automated shape and pose updating of building information model elements from 3D point clouds. Autom. Constr. 124, 103561 (2021). https://doi.org/10.1016/j.autcon.2021.103561
Bosché, F., Ahmed, M., Turkan, Y., Haas, C.T., Haas, R.: The value of integrating scan-to-BIM and scan-vs-BIM techniques for construction monitoring using laser scanning and BIM: the case of cylindrical MEP components. Autom. Constr. 49, 201–213 (2015). https://doi.org/10.1016/j.autcon.2014.05.014
Kavaliauskas, P., Fernandez, J.B., McGuinness, K., Jurelionis, A.: Automation of construction Progress monitoring by integrating 3D point cloud data with an IFC-based BIM model. Buildings. 12(10), (2022). https://doi.org/10.3390/buildings12101754
Golparvar-Fard, M., Peña-Mora, F., Savarese, S.: Automated Progress monitoring using unordered daily construction photographs and IFC-based building information models. J. Comput. Civ. Eng. 29(1), 1–19 (2015). https://doi.org/10.1061/(asce)cp.1943-5487.0000205
Roh, S., Aziz, Z., Peña-Mora, F.: An object-based 3D walk-through model for interior construction progress monitoring. Autom. Constr. 20(1), 66–75 (2011). https://doi.org/10.1016/j.autcon.2010.07.003
Pučko, Z., Šuman, N., Rebolj, D.: Automated continuous construction progress monitoring using multiple workplace real time 3D scans. Adv. Eng. Inform. 38(April), 27–40 (2018). https://doi.org/10.1016/j.aei.2018.06.001
Ekanayake, B., Wong, J.K.W., Fini, A.A.F., Smith, P.: Computer vision-based interior construction progress monitoring: a literature review and future research directions. Autom. Constr. 127, 103705 (2021). https://doi.org/10.1016/j.autcon.2021.103705
Cadena, C., et al.: Past, present, and future of simultaneous localization and mapping: toward the robust-perception age. IEEE Trans. Robot. 32(6), 1309–1332 (2016). https://doi.org/10.1109/TRO.2016.2624754
Kummerle, R., Steder, B., Dornhege, C., Kleiner, A., Grisetti, G., Burgard, W.: Large scale graph-based SLAM using aerial images as prior information. Auton. Robot. 30, 25–39 (2009). https://doi.org/10.1007/s10514-010-9204-1
Grisetti, G., Rainer, K., Stachniss, C.: A tutorial on graph-based SLAM. IEEE Intell. Transp. Syst. Mag. 2(4), 31–43 (2010). https://doi.org/10.1109/MITS.2010.939925
Vysotska, O., Stachniss, C.: Exploiting Building Information from Publicly Available Maps in Graph-Based SLAM. In: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 4511–4516 (2016). https://doi.org/10.1109/IROS.2016.7759664
Moura, M.S., Rizzo, C., Serrano, D.: BIM-based Localization and Mapping for Mobile Robots in Construction. In: 2021 IEEE International Conference on Autonomous Robot Systems and Competitions, ICARSC 2021, pp. 12–18 (2021). https://doi.org/10.1109/ICARSC52212.2021.9429779
Hess, W., Kohler, D., Rapp, H., Andor, D.: Real-time loop closure in 2D LIDAR SLAM. In: Proceedings - IEEE International Conference on Robotics and Automation, pp. 1271–1278 (2016, vol. 2016-June). https://doi.org/10.1109/ICRA.2016.7487258
Ye, C., Wang, Y., Lu, Z., Gilitschenski, I., Parsley, M., Julier, S.J.: Exploiting Semantic and Public Prior Information in MonoSLAM. In: 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4936–4941 (2020). https://doi.org/10.1109/IROS45743.2020.9340845
Parsley, M., Julier, S.J.: SLAM with a heterogeneous prior map. In: SEAS-DTC Conference (2009)
Doherty, K.J., Lu, Z., Singh, K., Leonard, J.J.: Discrete-continuous smoothing and mapping. IEEE Robot. Autom. Lett. 7(4), 12395–12402 (2022). https://doi.org/10.1109/lra.2022.3216938
Montemerlo, M., Thrun, S., Koller, D., Wegbreit, B.: FastSLAM: a factored solution to the simultaneous localization and mapping problem. In: Proceedings of the National Conference on Artificial Intelligence, pp. 593–598 (2002)
Hähnel, D., Burgard, W., Fox, D., Thrun, S.: An efficient FastSLAM algorithm for generating maps of large-scale cyclic environments from raw laser range measurements. IEEE International Conference on Intelligent Robots and Systems. 1, 206–211 (2003). https://doi.org/10.1109/iros.2003.1250629
Jo, K., Kim, C., Sunwoo, M.: Simultaneous localization and map change update for the high definition map-based autonomous driving car. Sensors. 18(9), (2018). https://doi.org/10.3390/s18093145
Murphy, K.P.: Bayesian map learning in dynamic environments. In: Advances in Neural Information Processing Systems, pp. 1015–1021 (2000)
Fox, D., Burgard, W., Dellaert, F., Thrun, S.: Monte Carlo Localization: Efficient Position Estimation for Mobile Robots. In: Proceedings of the National Conference on Artificial Intelligence, pp. 343–349 (1999)
Douc, R., Cappé, O., Moulines, E.: Comparison of Resampling Schemes for Particle Filtering. In: Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, pp. 64–69 (2005). https://doi.org/10.1109/ISPA.2005.195385
“IFC - BuildingSmart.” https://technical.buildingsmart.org/standards/ifc (accessed Feb. 08, 2023)
“IfcOpenShell.” https://ifcopenshell.org/ (accessed Feb. 08, 2023)
T. Möller and B. Trumbore, “Fast, minimum storage ray/triangle intersection,” ACM SIGGRAPH 2005 Courses, SIGGRAPH 2005, no. 1, pp. 1–7, 2005, https://doi.org/10.1145/1198555.1198746
Lam, S.K., Pitrou, A., Seibert, S.: Numba: A LLVM-based Python JIT Compiler. In: The International Conference for High Performance Computing, Networking, Storage and Analysis (2015). https://doi.org/10.1145/2833157.2833162
J. Solà, J. Deray, and D. Atchuthan, “A micro Lie theory for state estimation in robotics,” pp. 1–17, 2018, [Online]. Available: http://arxiv.org/abs/1812.01537
Q.-Y. Zhou, J. Park, and V. Koltun, “Open3D: A Modern Library for 3D Data Processing,” 2018, [Online]. Available: http://arxiv.org/abs/1801.09847
“amcl - ROS.” http://wiki.ros.org/amcl (accessed Feb. 08, 2023)
Thrun, S.: Learning occupancy grid maps with forward sensor models. Auton. Robot. 15, 111–127 (2003). https://doi.org/10.1023/A:1025584807625
Thrun, S., Burgard, W., Fox, D.: Probabilistic Robotics. MIT Press (2005)
Markiewicz, P., Porębski, J.: Developing occupancy grid with automotive simulation environment. Appl. Sci. (Switzerland). 10(21), 1–16 (2020). https://doi.org/10.3390/app10217629
Jarvis, R.A.: On the identification of the convex hull of a finite set of points in the plane. Inf. Process. Lett. 2(1), 18–21 (1973). https://doi.org/10.1016/0020-0190(73)90020-3
“BlenderBim.” https://blenderbim.org/ (accessed Feb. 08, 2023)
Robert, C.P.: Simulation of truncated normal variables. Stat. Comput. 5(2), 121–125 (1995). https://doi.org/10.1007/BF00143942
Campos, C., Elvira, R., Rodriguez, J.J.G., Montiel, J.M.M., Tardos, J.D.: ORB-SLAM3: an accurate open-source library for visual, visual-inertial, and multimap SLAM. IEEE Trans. Robot. 37(6), 1874–1890 (2021). https://doi.org/10.1109/TRO.2021.3075644
Labbé, M., Michaud, F.: RTAB-map as an open-source Lidar and visual SLAM library for large-scale and long-term online operation. J. Field. Robot. 36(2), 416–446 (2018) [Online]. Available: http://introlab.github.io/rtabmap/
Vizzo, I., Guadagnino, T., Mersch, B., Wiesmann, L., Behley, J., Stachniss, C.: KISS-ICP: In Defense of Point-to-Point ICP -- Simple, Accurate, and Robust Registration If Done the Right Way. IEEE Robot. Autom. Lett. 1–8 (2022). https://doi.org/10.48550/ARXIV.2209.15397
Dia, R., Lesecq, S., Mottin, J., Puschini, D.: General Inverse Sensor Model for Probabilistic Occupancy Grid Maps Using Multi-Target Sensors. In: 23rd International Symposium on Mathematical Theory of Networks and Systems, pp. 941–94s (2018)
Acknowledgments
This work was supported in part by the Ministry of Science, Israel.
Code or Data Availability
Not applicable.
Funding
This work was supported in part by the Ministry of Science, Israel.
Author information
Authors and Affiliations
Contributions
Both authors contributed to the work. Alon Spinner together with Amir Degani designed the general hypothesis and objectives. Alon Spinner formulated the algorithms and simulations. The first draft of the manuscript was written by Alon Spinner. Both authors contributed to the manuscript writing, and also read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics Approval
Not applicable.
Consent to Participate
Not applicable.
Consent for Publication
Informed consent was obtained from all the co-authors of this publication.
Competing Interests
There is no conflict of interest or competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Spinner, A., Degani, A. Online as-Built Building Information Model Update for Robotic Monitoring in Construction Sites. J Intell Robot Syst 110, 50 (2024). https://doi.org/10.1007/s10846-024-02087-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10846-024-02087-2