International Journal of Contents

The Korea Contents Association (한국콘텐츠학회)
권호 표지
DOI QR코드

DOI QR Code

Interactive Typography System using Combined Corner and Contour Detection

  • Lim, Sooyeon (School of Techno Public Talent Dongyang University) ;
  • Kim, Sangwook (School of Computer Science and Engineering Kyungpook National University)
  • Received : 2016.02.06
  • Accepted : 2017.03.17
  • Published : 2017.03.28
Download PDF
⟨ Previous Next ⟩

Abstract

Interactive Typography is a process where a user communicates by interacting with text and a moving factor. This research covers interactive typography using real-time response to a user's gesture. In order to form a language-independent system, preprocessing of entered text data presents image data. This preprocessing is followed by recognizing the image data and the setting interaction points. This is done using computer vision technology such as the Harris corner detector and contour detection. User interaction is achieved using skeleton information tracked by a depth camera. By synchronizing the user's skeleton information acquired by Kinect (a depth camera,) and the typography components (interaction points), all user gestures are linked with the typography in real time. An experiment was conducted, in both English and Korean, where users showed an 81% satisfaction level using an interactive typography system where text components showed discrete movements in accordance with the users' gestures. Through this experiment, it was possible to ascertain that sensibility varied depending on the size and the speed of the text and interactive alteration. The results show that interactive typography can potentially be an accurate communication tool, and not merely a uniform text transmission system.

Keywords

References

  1. J. C. Lee, J. Forlizzi, and S. E. Hudson, "The kinetic typography engine: an extensible system for animating expressive text," In Proceedings of the 15th annual ACM symposium on User interface software and technology, 2002, pp. 81-90.
  2. J. Lewis and A. Weyers, "ActiveText: a method for creating dynamic and interactive texts," In Proceedings of the 12th annual ACM symposium on User interface software and technology, 1999, pp. 131-140.
  3. J. Forlizzi, J. Lee, and S. Hudson, "The kinedit system: affective messages using dynamic texts," In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2003, pp. 377-384.
  4. J. Kato, T. Nakano, and M, Goto, "TextAlive: Integrated Design Environment for Kinetic Typography," In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, 2015, pp. 3403-3412.
  5. G. Bachfischer and T. Robertson, "From Movable Type to Moving Type-Evolution in technological mediated Typography," In Proceedings of the AUC Academic and Developers Conference, 2005.
  6. G. Bachfischer, T. Robertson, and A. Zmijewska, "A moving type framework," In Proceedings of the 10th WSEAS international conference on Communications. World Scientific and Engineering Academy and Society (WSEAS), 2006, p. 607-612.
  7. N. M. Lau and V. H. Chu, "Enhancing Children's Language Learning and Cognition Experience through Interactive Kinetic Typography," International Education Studies, vol. 8, no. 9, 2015, pp. 36-45.
  8. P. S. Cho, "Computational models for expressive dimensional typography," Doctoral dissertation, Massachusetts Institute of Technology, USA, 1999.
  9. S. Mitra and T. Acharya, "Gesture recognition: A survey," IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), vol. 37, no. 3, 2007, pp. 311-324. https://doi.org/10.1109/TSMCC.2007.893280
  10. P. Kakumanu, S. Makrogiannis, and N. Bourbakis, "A survey of skin-color modeling and detection methods," Pattern Recognition, vol. 40, no. 3, 2007, pp. 1106-1122. https://doi.org/10.1016/j.patcog.2006.06.010
  11. T. B. Moeslund, A. Hilton, and V. Kruger, "A survey of advances in vision-based human motion capture and analysis," Computer vision and image understanding, vol. 104, no. 2, 2006, pp. 90-126. https://doi.org/10.1016/j.cviu.2006.08.002
  12. T. Osunkoya and J. C. Chern, "Gesture-based Human Computer Interaction using Kinect for Windows Mouse Control and Powerpoint Presentation," In Proceedings of the Midwest Instruction and Computing Symposium, Wisconsin, USA, 2013.
  13. K. T. M. Tran and S. H. Oh, "Hand Gesture Recognition for 3D-Heritage-Tourism using Microsoft Kinect Sensor," Advanced Science and Technology Letters, vol. 30, 2013, pp. 145-148.
  14. J. Shotton, T. Sharp, A. Kipman, A. Fitzgibbon, M. Finocchio, A. Blake, M. Cook, and R. Moore, "Realtime human pose recognition in parts from single depth images," Communications of the ACM, vol. 56, no. 1, 2013, pp. 116-124. https://doi.org/10.1145/2398356.2398381
  15. M. Van den Bergh, D. Carton, R. De Nijs, N. Mitsou, C. Landsiedel, K. Kuehnlenz, D. Wollherr, L. Van Gool, M. Buss, "Real-time 3D hand gesture interaction with a robot for understanding directions from humans," In Proceedings of the International Symposium on Robot and Human Interactive Communication, 2011, pp. 357-362.
  16. D. Wagner, G. Reitmayr, A. Mulloni, T. Drummond, and D. Schmalstieg, "Pose tracking from natural features on mobile phones," In Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality. IEEE Computer Society, 2008, pp. 125-134.
  17. S. M. Smith and M. Brady, "SUSAN - A New Approach to Low Level Image Processing," International Journal of Computer Vision, vol. 23, no. 1, 1997, pp. 45-78. https://doi.org/10.1023/A:1007963824710
  18. M. Trajkovic and M. Hedley, "Fast Corner Detection," Image and Vision Computing, vol. 16, no. 2, 1998, pp. 75-87. https://doi.org/10.1016/S0262-8856(97)00056-5
  19. S. C. Bae, I. S. Kweon, and C. D. Yoo, "COP: a new corner detector," Pattern Recognition Letters, vol. 23, 2002, pp. 1349-1360. https://doi.org/10.1016/S0167-8655(02)00083-1
  20. L. J. Latecki and R. Lakamper, "Convexity rule for shape decomposition based on discrete contour evolution," Computer Vision and Image Understanding, vol. 73, no. 3, 1999, pp. 441-454. https://doi.org/10.1006/cviu.1998.0738
  21. U. Orguner and F. Gustafsson, "Statistical characteristics of harris corner detector," In Proceedings of the IEEE/SP 14th Workshop on Statistical Signal Processing, vol. 2629, 2007, pp. 571-575.
  22. C. Harris and M. Stephens, "A Combined Corner and Edge Detector," In Proceedings of the Alvey Vision Conference, vol. 15, 1988, pp. 147-151.
  23. K. G. Derpanis, The Harris Corner Detector, 2004. Accessed Aug. 13. http://www.cse.yorku.ca/-kosta/CompVis_Notes/ harris_detector.pdf, 2016.
  24. R. Fabbri, L. Da F. Costa, J. C. Torelli, and O. M. Bruno, "2D Euclidean distance transform algorithms: A comparative survey," ACM Computing Surveys (CSUR), vol. 40, issue. 1, no. 2, 2008.