Journal of Information Processing Systems

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Study on Data Processing of the IOT Sensor Network Based on a Hadoop Cloud Platform and a TWLGA Scheduling Algorithm

  • Li, Guoyu (School of Information Engineering, Handan University) ;
  • Yang, Kang (School of Information Engineering, Handan University)
  • Received : 2021.08.11
  • Accepted : 2021.10.10
  • Published : 2021.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

An Internet of Things (IOT) sensor network is an effective solution for monitoring environmental conditions. However, IOT sensor networks generate massive data such that the abilities of massive data storage, processing, and query become technical challenges. To solve the problem, a Hadoop cloud platform is proposed. Using the time and workload genetic algorithm (TWLGA), the data processing platform enables the work of one node to be shared with other nodes, which not only raises efficiency of one single node but also provides the compatibility support to reduce the possible risk of software and hardware. In this experiment, a Hadoop cluster platform with TWLGA scheduling algorithm is developed, and the performance of the platform is tested. The results show that the Hadoop cloud platform is suitable for big data processing requirements of IOT sensor networks.

Keywords

Acknowledgement

This paper is supported by the project of National Natural Science Foundation of China (No. 62175055) and the Research Fund of Handan University (No. 16215).

References

  1. A. C. Sarma and J. Girao, "Identities in the future Internet of Things," Wireless Personal Communications, vol. 49, no. 3, pp. 353-363, 2009. https://doi.org/10.1007/s11277-009-9697-0
  2. D. Bandyopadhyay and J. Sen, "Internet of things: applications and challenges in technology and standardization," Wireless Personal Communications, vol. 58, no. 1, pp. 49-69, 2011. https://doi.org/10.1007/s11277-011-0288-5
  3. R. Roman, C. Alcaraz, J. Lopez, and N. Sklavos, "Key management systems for sensor networks in the context of the Internet of Things," Computers & Electrical Engineering, vol. 37, no. 2, pp. 147-159, 2011. https://doi.org/10.1016/j.compeleceng.2011.01.009
  4. L. Wang, G. Von Laszewski, A. Younge, X. He, M. Kunze, J. Tao, and C. Fu, "Cloud computing: a perspective study," New Generation Computing, vol. 28, no. 2, pp, 137-146, 2010. https://doi.org/10.1007/s00354-008-0081-5
  5. J. Yan, X. Wang, Q. Gan, S. Li, and D. Huang, "Secure and efficient big data deduplication in fog computing," Soft Computing, vol. 24, no. 8, pp. 5671-5682, 2020. https://doi.org/10.1007/s00500-019-04215-9
  6. P. Liu, Cloud Computing. Beijing, China: Electronic Industry Press, 2010.
  7. H. Yedidsion, S. Ashur, A. Banik, P. Carmi, M. J. Katz, and M. Segal, "Sensor network topology design and analysis for efficient data gathering by a mobile mule," Algorithmica, vol. 82, no. 10, pp. 2784-2808, 2020. https://doi.org/10.1007/s00453-020-00704-8
  8. E. Suganya and C. Rajan, "An AdaBoost-modified classifier using particle swarm optimization and stochastic diffusion search in wireless IoT networks," Wireless Networks, vol. 27, no. 4, pp. 2287-2299, 2021. https://doi.org/10.1007/s11276-020-02504-y
  9. K. Preethi and R. Tamilarasan, "Monitoring of air pollution to establish optimal less polluted path by utilizing wireless sensor network," Journal of Ambient Intelligence and Humanized Computing, vol. 12, no. 6, pp. 6375-6386, 2021. https://doi.org/10.1007/s12652-020-02232-3
  10. P. K. Yadav, A. Aggarwal, and M. P. Singh, "Workload analysis in a grid computing environment: a genetic approach," International Journal of Computer Applications, vol. 93, no. 16, pp. 26-29, 2014. https://doi.org/10.5120/16300-6106
  11. H. Aziza and S. Krichen, "A hybrid genetic algorithm for scientific workflow scheduling in cloud environment," Neural Computing & Applications, vol. 32, no. 18, pp. 15263-15278, 2020. https://doi.org/10.1007/s00521-020-04878-8
  12. A. Tuncer and M. Yildirim, "Chromosome coding methods in genetic algorithm for path planning of mobile robots," in Computer and Information Sciences II. London, UK: Springer, 2011, pp. 377-383.
  13. L. Li, M. Guo, L. Ma, H. Mao, and Q. Guan, "Online workload allocation via fog-fog-cloud cooperation to reduce IoT task service delay," Sensors, vol. 19, no. 18, article no. 3830, 2019. https://doi.org/10.3390/s19183830
  14. S. A. B. Shah, M. Rashid, and M. Arif, "Estimating WCET using prediction models to compute fitness function of a genetic algorithm," Real-Time Systems, vol. 56, pp. 28-63, 2020. https://doi.org/10.1007/s11241-020-09343-2
  15. Z. Zhou, F. Li, H. Zhu, H. Xie, J. H. Abawajy, and M. U. Chowdhury, "An improved genetic algorithm using greedy strategy toward task scheduling optimization in cloud environments," Neural Computing and Applications, vol. 32, no. 6, pp. 1531-1541, 2020. https://doi.org/10.1007/s00521-019-04119-7