Journal of Internet of Things and Convergence (사물인터넷융복합논문지)

The Korea Internet of Things Society (한국사물인터넷학회)
권호 표지
DOI QR코드

DOI QR Code

Implementation of Brain-machine Interface System using Cloud IoT

클라우드 IoT를 이용한 뇌-기계 인터페이스 시스템 구현

  • Hoon-Hee Kim (Dept. of Computer Engineering, Pukyong National University)
  • 김훈희 (부경대학교 컴퓨터공학부)
  • Received : 2022.12.27
  • Accepted : 2023.02.06
  • Published : 2023.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

The brain-machine interface(BMI) is a next-generation interface that controls the device by decoding brain waves(also called Electroencephalogram, EEG), EEG is a electrical signal of nerve cell generated when the BMI user thinks of a command. The brain-machine interface can be applied to various smart devices, but complex computational process is required to decode the brain wave signal. Therefore, it is difficult to implement a brain-machine interface in an embedded system implemented in the form of an edge device. In this study, we proposed a new type of brain-machine interface system using IoT technology that only measures EEG at the edge device and stores and analyzes EEG data in the cloud computing. This system successfully performed quantitative EEG analysis for the brain-machine interface, and the whole data transmission time also showed a capable level of real-time processing.

뇌-기계 인터페이스는 차세대 인터페이스로서 기기 이용자가 명령을 생각할 때 발생하는 신경세포의 전기적 신호인 뇌파를 해석하여 기기를 조종하는 인터페이스다. 뇌-기계 인터페이스는 다양한 스마트기기 등에 응용될 수 있지만 뇌파 신호를 해석하는 데는 상당량의 계산 프로세스가 필요하다. 따라서 에지(Edge) 형태로 구현된 임베디드 시스템에서는 뇌-기계 인터페이스를 구현하기가 어렵다. 본 연구에서는 사물인터넷 기술을 이용하여 에지에서는 뇌파 측정만을 진행하고 뇌파 데이터의 저장 및 분석은 클라우드 컴퓨팅에서 수행하는 새로운 형태의 뇌-기계 인터페이스 시스템을 제안하였다. 본 시스템은 뇌-기계 인터페이스를 위한 정량 뇌파 분석을 성공적으로 수행하였으며 데이터 송수신 시간 또한 실시간 처리가 가능한 수준을 보였다.

Keywords

Acknowledgement

본 논문은 과학치안 공공연구성과 실용화 촉진 시범사업 연구과제(No. 1711174175)로 수행되었음.

References

  1. P. R. Roelfsema, D. Denys, and P. C. Klink, "Mind Reading and Writing: The Future of Neurotechnology," Trends in Cognitive Sciences, Vol.22, No.7, pp.598-610, 2018. https://doi.org/10.1016/j.tics.2018.04.001
  2. M. A. Lebedev and M. A. L. Nicolelis, "Brain-machine interfaces: past, present and future," Trends in Neurosciences, Vol.29, No.9, pp.536-546, 2006. https://doi.org/10.1016/j.tins.2006.07.004
  3. F. Lopes da Silva, "EEG and MEG: Relevance to Neuroscience," Neuron, Vol.80, No.5, pp.1112-1128, 2013. https://doi.org/10.1016/j.neuron.2013.10.017
  4. D. J. McFarland, W. A. Sarnacki, and J. R. Wolpaw, "Electroencephalographic(EEG) control of three-dimensional movement," Journal of Neural Engineering, Vol.7, No.3, pp.1-9, 2010. https://doi.org/10.1088/1741-2560/7/3/036007
  5. Y. Chae, J. Jeong, and S. Jo, "Toward brain-actuated humanoid robots: Asynchronous direct control using an EEG-Based BCI," IEEE Transactions on Robotics, Vol.28, No.5, pp.1131-1144, 2012. https://doi.org/10.1109/TRO.2012.2201310
  6. K. Volkova, M. A. Lebedev, A. Kaplan, and A. Ossadtchi, "Decoding Movement From Electrocorticographic Activity: A Review," Frontiers in Neuroinformatics, Vol.13, pp.1-20, 2019. https://doi.org/10.3389/fninf.2019.00001
  7. K. Lafleur, K. Cassady, A. Doud, K. Shades, E. Rogin, and B. He, "Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain-computer interface," Journal of Neural Engineering, Vol.10, No.4, pp.1-15, 2013. https://doi.org/10.1088/1741-2560/10/4/046003
  8. H. H. Kim and J. Jeong, "An electrocorticographic decoder for arm movement for brain-machine interface using an echo state network and Gaussian readout," Applied Soft Computing, Vol.117, pp.1-13, 2022. https://doi.org/10.1016/j.asoc.2021.108393
  9. O. Al Zoubi, M. Awad, and N. K. Kasabov, "Anytime multipurpose emotion recognition from EEG data using a Liquid State Machine based framework," Artificial Intelligence in Medicine, Vol.86, pp.1-8, 2018. https://doi.org/10.1016/j.artmed.2018.01.001
  10. L. Bozhkov, P. Koprinkova-Hristova, and P. Georgieva, "Reservoir computing for emotion valence discrimination from EEG signals," Neurocomputing, Vol.231, pp.28-40, 2017. https://doi.org/10.1016/j.neucom.2016.03.108
  11. H. S. Wi and B. M. Lee, "Classification Method of Sleep Induction Sounds in Sleep Care Service based on Brain Wave," Journal of Korea Multimedia Society, Vol.23, No.11, pp.1406-1417, 2020. https://doi.org/10.9717/KMMS.2020.23.11.1406
  12. E. Tidoni, P. Gergondet, G. Fusco, A. Kheddar, and S. M. Aglioti, "The Role of Audio-Visual Feedback in a Thought-Based Control of a Humanoid Robot: A BCI Study in Healthy and Spinal Cord Injured People," IEEE Transactions on Neural Systems and Rehabilitation Engineering, Vol.25, No.6, pp.772-781, 2017. https://doi.org/10.1109/TNSRE.2016.2597863
  13. K.H. Kim and K.H. Lee, "A Scheme of Identity Authentication and Anomaly Detection using ECG and Beacon-based Blockchain," Journal of Internet of Things and Convergence, Vol.7, No.3, pp.69-74, 2021. https://doi.org/10.20465/KIOTS.2021.7.3.069
  14. J. Y. Kwak, Y. J. Yang, J. K. Lim, S. C. Yoon and T. W. Ahn, "A Study to Improve the Usability of the Smart Sleeping Mask based IoT," Journal of Internet of Things and Convergence, Vol.8, No.6, pp.27-33, 2022. https://doi.org/10.20465/KIOTS.2022.8.6.027
  15. A. Mognon, J. Jovicich, L. Bruzzone and M. Bulatti, "ADJUST: An automatic EEG artifact detector based on the joint use of spatial and temporal features," Psychophysiology, Vol.48, No.2, pp.229-240, 2011. https://doi.org/10.1111/j.1469-8986.2010.01061.x