Journal of the Korea Society of Computer and Information (한국컴퓨터정보학회논문지)

Korean Society of Computer Information (한국컴퓨터정보학회)
권호 표지
DOI QR코드

DOI QR Code

A New Exploratory Testing Method for Improving the Effective IP Set-Top Box Test

  • Kim, Donghyun (Dept. of Computer and Communications Engineering, Kangwon National University) ;
  • Kim, Yoon (Dept. of Computer and Communications Engineering, Kangwon National University)
  • Received : 2017.11.10
  • Accepted : 2018.02.12
  • Published : 2018.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

Recently, as various IP set-top boxes based on Android OS have been widely used in general households and public facilities, complaints about services and set-top boxes have continued to increase as much as other smart devices. In order to reduce this problem, the manufacturer performs the testing work before the product is commercialized. However, the testing can reduce potential defects in the product, but it can not prove that the product is free of defects. Therefore, the quality of the product can vary depending on how effective testing techniques are introduced. In this paper, we propose a new exploratory testing method that minimizes test case creation time and makes it easier to plan and execute test while simultaneously learning how to run the product under test. Using the first proposed method, the test time is reduced by about 16.7 hours and the defect detection rate is 25.4% higher than the formal specification-based testing method. Informally, the test time was shortened by about 4.7 hours and the defect detection rate was 13% higher than the informal experience-based testing method.

Keywords

References

  1. TTA Journal, Changsik Jo and Pyeongsu Ma, "IP Set top box SW platform technology," pp.67, 2004.
  2. KIBA, KAIT, KEA, "IPTV Subscriber status", 2016.
  3. Broekman, E. Notenboom, "Testing Embedded Software Addison-Wesley", 2003.
  4. J. Regehr, "Random testing of interrupt-driven software", In Proc. of the Conf. on Embedded Software (EMSOFT), pp.290, pp.298, 2005.
  5. Wonil Kwon, Christen Eunyoung Park, Hyunjoo Lee, and Hyungil Cho, "Developers Need to Know Practice of Software Testing," the third edition, STA Testing consulting, pp.92, 2012.
  6. ISO/IEC/IEEE DIS 29119 - 4 Software and Systems Engineering - Software Testing - Part 4: Test Techniques.
  7. NIPA, STA Testing consulting, "Software Testing Practice Guide," STA, pp.197, 2012.
  8. Wikipedia(IPTV), http://ko.wikipedia.org/wiki/IPTV.
  9. TTA Journal, Changsik Jo and Pyeongsu Ma, "IP Set top box SW platform technology," pp.68, 2004.
  10. Junkeun Kim and Sungjin Choi, "A Study on the Analysis of Similarities between IPTV and DCATV," Seoul Univ, Master's thesis, pp.23, 2008.
  11. MKE,NIPA, "Open Source Software Test Guide," pp.4, 2012.
  12. Kyungsu Kim and Yongsuk Kim, "A Performance Evaluation of Software Testing Methods for Medical Devices," Kangwon Univ, Master's thesis, pp.23, 2013.
  13. Jaechul Lee and Yoon Kim, "Wi-Fi Directional Test Simplification for Smart Set-Top Box Based on Pair-Wise Testing," Journal of the Korea Society of Computer and Information, Vol. 20, No. 3, pp.1-8, 2015. https://doi.org/10.9708/JKSCI.2015.20.3.001
  14. Seunghee Choi and Gooyeun Lee, "A Study of Test Design Framework (R-TDF) Based on Information System Requirement," Kangwon Univ, Master's thesis, pp.30, 2013.
  15. Jonghyun Park and Myunghee Seo, "Research of Audit Detail Check Method for Applied Systems Using Black Box Testing," Konkuk Univ, Master's thesis, pp.25, 2013.
  16. Wonil Kwon, Christen Eunyoung Park, Hyunjoo Lee, and Hyungil Cho, "Developers Need to Know Practice of Software Testing," the third edition, STA Testing consulting, pp.153, 2012.
  17. NIPA,STA Testing consulting, "Software Testing Practice Guide," STA, pp.209, 2012.
  18. James Back, "What is Exploratory Testing?," Satisfice Inc, articles, 2017.
  19. Wikipedia(PMI), http://ko.wikipedia.org/wiki/PMI
  20. ISTQB, "Certified Tester Foundation Level Syllabus," pp.14, 2011.
  21. Jonggu Kim and Hoyeol Kwon, "Improvement of Software Testing Quality for Medical Ultrasound System Using Exploratory Testing," Journal of the Institte of Electronics and Information Engineers, pp.691-693, 2012.
  22. Jangwoo Cho and Cheolhwan Jung, "An Effective Method of Testing Application Software of Smart Sensors," Journal of the Korea Society of Computer and Information, pp.105-111, 2013.
  23. Jinho Lee ,Cheolhyun Jung, Seunggun Gang, Hyunwoo Jo, Jemyung Lee, Myungjoo Gang, Changil Park, Hyunjoo Ooh, Sangjung Kim, and Jongwon Lee, "Games QA using Checklists Technique," Journal of the Korea Society of Computer and Information, pp.307-310, 2014.
  24. DongGyu Kwak, Chae-Woo Yoo, Jaeyoung Choi, "A Design and Implementation of Reliability Analyzer for Embedded Software using Markov Chain Model and Unit Testing," Journal of the Korea Society of Computer and Information, pp.1-10, 2011.
  25. Sooyong Jeong○, Tae-San Baek, Bueng Il Hwang, Woo Jin Lee, "A Testing on Robustness of Embedded Software Based on Software-in-the-Loop Simulation," Journal of the Korea Society of Computer and Information, pp.5-8, 2015.