Korean Journal of Computational Design and Engineering (한국CDE학회논문집)

Society for Computational Design and Engineering (한국CDE학회)
권호 표지
DOI QR코드

DOI QR Code

Construction of Skin Color Map for Resolving Hand Occlusion in AR Environments

증강현실 환경에서 손 가림 해결을 위한 피부 색상 정보 획득

  • Park, Sang-Jin (Department of Industrial Engineering, Chosun University) ;
  • Park, Hyungjun (Department of Industrial Engineering, Chosun University)
  • Received : 2014.01.08
  • Accepted : 2014.04.08
  • Published : 2014.06.01
Download PDF
⟨ Previous Next ⟩

Abstract

In tangible augmented reality (AR) environments, the user interacts with virtual objects by manipulating their physical counterparts, but he or she often encounters awkward situations in which his or her hands are occluded by the augmented virtual objects, which causes great difficulty in figuring out hand positions, and reduces both immersion and ease of interaction. To solve the problem of such hand occlusion, skin color information has been usefully exploited. In this paper, we propose an approach to simple and effective construction of a skin color map which is suitable for hand segmentation and tangible AR interaction. The basic idea used herein is to obtain hand images used in a target AR environment by simple image subtraction and to represent their color information by a convex polygonal map in the YCbCr color space. We experimentally found that the convex polygonal map is more accurate in representing skin color than a conventional rectangular map. After implementing a solution for resolving hand occlusion using the proposed skin color map construction, we showed its usefulness by applying it to virtual design evaluation of digital handheld products in a tangible AR environment.

Keywords

References

  1. Van Krevelen, D.W.F. and Poelman, R., 2010, A Survey of Augmented Reality Technologies, Applications and Limitations, The International Journal of Virtual Reality, 9(2), pp.1-20.
  2. Park, H. and Moon, H.C., 2008, Design Evaluation of Portable Electronic Products Using AR-Based Interaction and Simulation, Transactions of the Society of CAD/CAM Engineers, 13(3), pp.209-216.
  3. Park, H. and Moon, H.C., 2011, AR-based Tangible Interaction Using a Finger Fixture for Digital Handheld Products, Transactions of the Society of CAD/CAM Engineers, 16(1), pp.1-10.
  4. Park, H. and Moon, H.C., 2011, Resolving Hand Region Occlusion in Tangible Augmented Reality Environments, Transactions of the Society of CAD/CAM Engineers, 16(4), pp.227-284.
  5. Yoon, H.S., Sho, J., Bea, C.S., Chun, B.T. and Min, B.W., 1997, Window Manager Control using Hand Gesture Recognition, Workshop of the Institute of Electronics Engineering of Korea, 9(1), pp.264-269.
  6. Song, H.S. and Yang, Y.M., 1998, Hand Tracking and Region Extraction based on Optical Flow, Korean Institute of Information Scientists and Engineerings, 25(1), pp.634-644.
  7. Tanibata, N., Shimada, N. and Shirai, Y., 2002, Extraction of Hand Features for Recognition of Sign Language Words, Proceedings of International Conference on Vision Interface, pp.391-398.
  8. Moghaddam, B. and Pentland, A., 1995, Probabilistic Visual Learning for Object Detection, Proceedings of the 5th International Conference on Computer Vision, pp.786-793.
  9. Imagawa, K., Shan, L. and Igi, S., 1996, Color-based Hands Tracking System for Sign Language Recognition, Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition, Killington, pp.151-156.
  10. Wengun, T., Wu, C., Shuyiong, Z. and Shuo, C., 2009, Hand Extraction Using Geometric Moments Based on Active Skin Color Model, Proceedings of IEEE International Conference on Intelligent Computing and Intelligent Systems, pp.468-471.
  11. Lee, W.H. and Park, J., 2005, Augmented Foam: A Tangible Augmented Reality for Product Design, Proceedings of ISMAR, pp.106-109.
  12. Chun, J. and Lee, B., 2010, Dynamic Manipulation of a Virtual Object in Marker-less AR system Based on Both Human Hands, KSII Transactions on Internet and Information Systems, 4(4), pp.618-632. https://doi.org/10.3837/tiis.2010.08.000
  13. Moon, H.C. and Park, H., 2011, Resolving Hand Region Occlusion in Tangible Augmented Reality Environments, Transactions of the Society of CAD/CAM Engineers, 16(4), pp.277-284.
  14. Tan, W., Wu, C., Zhao, S. and Chen, S., 2009, Hand Extraction Using Geometric Moments Based on Active Skin Color Model, Proceedings of IEEE International Conference on Intelligent Computing and Intelligent Systems, pp.468-471.
  15. Lee, T. and Hollerer, T., 2007, Handy AR:Markerless Inspection of Augmented Reality Objects Using Fingertip Tracking, Proceedings of IEEE International Symposium on Wearable Computers, pp.83-90.
  16. Park, H., Moon, H.C. and Lee, J.Y., 2009, Tangible augmented prototyping of digital handheld products, Computers in Industry, 60(2), pp.114-125. https://doi.org/10.1016/j.compind.2008.09.001
  17. OpenCV, http://opencv.org/