International conference on construction engineering and project management (국제학술발표논문집)

  • 2024.07a
  • /
  • Pages.1049-1056
  • /
  • 2024
  • /
  • 2508-9048(eISSN)
Korea Institute of Construction Engineering and Management (한국건설관리학회)
권호 표지
DOI QR코드

DOI QR Code

The Effects of a Co-Worker's Cognitive Response on Human-Robot Team Productivity in Construction

  • Francis BAEK (Department of Civil and Environmental Engineering, University of Michigan) ;
  • Juhyeon BAE (Department of Civil and Environmental Engineering, University of Michigan) ;
  • Changbum AHN (Department of Architecture and Architectural Engineering, Seoul National University) ;
  • SangHyun LEE (Department of Civil and Environmental Engineering, University of Michigan)
  • Published : 2024.07.29
Download PDF
⟨ Previous Next ⟩

Abstract

Human-robot collaboration (HRC) is an emerging form of work anticipated to improve construction productivity by integrating robotic capabilities with human expertise. With the expected transition towards tasks that demand more cognitive efforts for human workers, considering the cognitive status of each co-worker, such as task engagement and vigilance, can become crucial to achieve high-quality human performance during HRC, potentially contributing to a more productive HRC in construction. However, the potential cognitive changes of each co-worker have remained unclear during HRC, as studies have primarily focused on identifying general trends from aggregated cognitive responses of people, in which an individual's response can be overlooked. In this study, we examine the cognitive response of each co-worker during HRC for a construction task. We observed the cognitive responses of 18 people while they were experiencing different collaborating conditions, such as the robot's different movement speed, during a bricklaying task with an arm-type collaborative robot. For each participant, we analyzed electroencephalogram (EEG) signals to identify the changes in cognitive status by using a wearable EEG headset. The results present that the cognitive responses of almost all the participants were significantly and differently affected during HRC, impacting the estimated productivity of their human-robot teams. The findings of the study present the importance of considering each co-worker's potentially unique cognitive response as a way to achieve cognitive wellbeing while pursuing high productivity within human-robot teams, potentially contributing to overall productive HRC in construction.

Keywords

Acknowledgement

This research was supported by Brain Pool program funded by the Ministry of Science and ICT through the National Research Foundation of Korea (RS-2023-00284237). Any opinions, findings, conclusions, or recommendations expressed in this paper are those of the authors and do not necessarily reflect the views of the National Research Foundation of Korea.

References

  1. L. Sveikauskas, S. Rowe, J.D. Mildenberger, Measuring productivity growth in construction, Monthly Lab. Rev. 141 (2018) 1.
  2. U.S. Bureau of Labor Statistics (BLS), National Census of Fatal Occupational Injuries in 2022. https://www.bls.gov/news.release/pdf/cfoi.pdf (accessed February 16, 2024).
  3. McKinsey Global Institute, Reinventing Construction: A Route To Higher Productivity, Washington, D. C., 2017. http://www.mckinsey.com/industries/capital-projects-and-infrastructure/our-insights/reinventing-construction-through-a-productivity-revolution (accessed February 17, 2022).
  4. R.K. Sokas, X.S. Dong, C.T. Cain, Building a sustainable construction workforce, International Journal of Environmental Research and Public Health 16 (21) (2019) 4202.
  5. C.-J. Liang, X. Wang, V.R. Kamat, C.C. Menassa, Human-robot collaboration in construction: Classification and research trends, Journal of Construction Engineering and Management 147 (10) (2021) 03121006.
  6. A. Vysocky, P. Novak, Human-Robot collaboration in industry, MM Science Journal 9 (2) (2016) 903-906.
  7. X. Wang, D. Veeramani, Z. Zhu, Wearable Sensors-Based Hand Gesture Recognition for Human-Robot Collaboration in Construction, IEEE Sensors Journal 23 (1) (2022) 495-505.
  8. X. Wang, D. Veeramani, Z. Zhu, Gaze-aware hand gesture recognition for intelligent construction, Engineering Applications of Artificial Intelligence 123 (2023) 106179.
  9. S. Sarkar, Y. Jang, I. Jeong, Multi-camera-based 3D human pose estimation for close-proximity human-robot collaboration in construction.
  10. O.E. Dictionary, Oxford english dictionary, Simpson, Ja & Weiner, Esc 3 (1989).
  11. S. Shayesteh, H. Jebelli, Investigating the impact of construction robots autonomy level on workers' cognitive load, Canadian Society of Civil Engineering Annual Conference, Springer, 2021, pp. 255-267.
  12. D.U. Wulff, S. De Deyne, S. Aeschbach, R. Mata, Using network science to understand the aging lexicon: Linking individuals' experience, semantic networks, and cognitive performance, Topics in Cognitive Science 14 (1) (2022) 93-110.
  13. M. Koppenborg, P. Nickel, B. Naber, A. Lungfiel, M. Huelke, Effects of movement speed and predictability in human-robot collaboration, Human Factors and Ergonomics in Manufacturing & Service Industries 27 (4) (2017) 197-209.
  14. F. Baek, D. Kim, G. Lee, B. Choi, S. Lee, Emotional Response Modeling for Human-Robot Collaboration in Construction., The 22nd International Conference on Construction Applications of Virtual Reality, Seoul, Korea, 2022.
  15. M. Morikawa, Who are afraid of losing their jobs to artificial intelligence and robots? Evidence from a survey, GLO Discussion Paper, 2017.
  16. A. Murata, An attempt to evaluate mental workload using wavelet transform of EEG, Human factors 47 (3) (2005) 498-508.
  17. F. Dehais, A. Lafont, R. Roy, S. Fairclough, A neuroergonomics approach to mental workload, engagement and human performance, Frontiers in neuroscience 14 (2020) 268.
  18. C. Berka, D.J. Levendowski, M.N. Lumicao, A. Yau, G. Davis, V.T. Zivkovic, R.E. Olmstead, P.D. Tremoulet, P.L. Craven, EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks, Aviation, space, and environmental medicine 78 (5) (2007) B231-B244.
  19. B.S. Oken, M.C. Salinsky, S. Elsas, Vigilance, alertness, or sustained attention: physiological basis and measurement, Clinical neurophysiology 117 (9) (2006) 1885-1901.
  20. B. Cheng, C. Fan, H. Fu, J. Huang, H. Chen, X. Luo, Measuring and computing cognitive statuses of construction workers based on electroencephalogram: a critical review, IEEE Transactions on Computational Social Systems 9 (6) (2022) 1644-1659.
  21. G. Matthews, D.J. Saxby, G.J. Funke, A.K. Emo, P.A. Desmond, Driving in states of fatigue or stress, (2011).
  22. Y. Lin, H. Cai, A method for building a real-time cluster-based continuous mental workload scale, Theoretical Issues in Ergonomics Science 10 (6) (2009) 531-543.