ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

A Novel Interaction Method for Mobile Devices Using Low Complexity Global Motion Estimation

  • Nguyen, Toan Dinh (Department of Electronics and Computer Engineering, Chonnam National University) ;
  • Kim, JeongHwan (Department of Electronics and Computer Engineering, Chonnam National University) ;
  • Kim, SooHyung (Department of Electronics and Computer Engineering, Chonnam National University) ;
  • Yang, HyungJeong (Department of Electronics and Computer Engineering, Chonnam National University) ;
  • Lee, GueeSang (Department of Electronics and Computer Engineering, Chonnam National University) ;
  • Chang, JuneYoung (Creative & Challenging Research Division, ETRI) ;
  • Eum, NakWoong (SW-SoC Convergence Research Laboratory, ETRI)
  • Received : 2012.01.31
  • Accepted : 2012.06.22
  • Published : 2012.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

A novel interaction method for mobile phones using their built-in cameras is presented. By estimating the path connecting the center points of frames captured by the camera phone, objects of interest can be easily extracted and recognized. To estimate the movement of the mobile phone, corners and corresponding Speeded-Up Robust Features descriptors are used to calculate the spatial transformation parameters between the previous and current frames. These parameters are then used to recalculate the locations of the center points in the previous frame into the current frame. The experiment results obtained from real image sequences show that the proposed system is efficient, flexible, and able to provide accurate and stable results.

Keywords

References

  1. J. Rekimoto, "Tilting Operations for Small Screen Interfaces," 9th Annual ACM Symp. User Interface Softw. Technol., Seattle, WA, USA, 1996, pp. 167-168.
  2. B.L. Harrison et al., "Squeeze Me, Hold Me, Tilt Me! An Exploration of Manipulative User Interfaces," SIGCHI Conf. Human Factors Computing Systems, Los Angeles, CA, USA, 1998, pp. 17-24.
  3. K. Hinckley et al., "Sensing Techniques for Mobile Interaction," 13th Annual ACM Symp. User Interface Softw. Technol., San Diego, CA, USA, 2000, pp. 91-100.
  4. K. Partridge et al., "TiltType: Accelerometer-Supported Text Entry for Very Small Devices," 15th Annual ACM Symp. User Interface Softw. Technol., Paris, France, 2002, pp. 201-204.
  5. H. Yong, J. Back, and T.-J. Jang, "Stereo-Vision-Based Human- Computer Interaction with Tactile Stimulation," ETRI J., vol. 29, no. 3, 2007, pp. 305-310. https://doi.org/10.4218/etrij.07.0506.0017
  6. T.B. Moeslund and E. Granum, "A Survey of Computer Vision- Based Human Motion Capture," Comput. Vis. Image Underst., vol. 81, no. 3, 2001, pp. 231-268. https://doi.org/10.1006/cviu.2000.0897
  7. J. Wang, S. Zhai, and J. Canny, "Camera Phone Based Motion Sensing: Interaction Techniques, Applications and Performance Study," 19th Annual ACM Symp. User Interface Softw. Technol., Montreux, Switzerland, 2006, pp. 101-110.
  8. J. Wang and J. Canny, "TinyMotion: Camera Phone Based Interaction Methods," CHI Extended Abstracts on Human Factors in Computing Systems, Canada, 2006, pp. 339-344.
  9. A. Krutz et al., "Windowed Image Registration for Robust Mosaicing of Scenes with Large Background Occlusions," ICIP, 2006, pp. 353-356.
  10. M. Barnard et al., "A Vision Based Motion Interface for Mobile Phones," Computer Vision Syst., 2007.
  11. T.N. Dinh, J.H. Kim, and G. Lee, "Extracting the Path of Frame Center Points Using Spatial Transformation and Motion Estimation," Int. Conf .Computer Inf. Technol. (CIT), 2011, pp. 283-290.
  12. C. Harris and M. Stephens, "A Combined Corner and Edge Detector," 4th Alvey Vision Con., 1988, pp. 147-151.
  13. H. Bay et al., Speeded Up Robust Features (SURF)," Computer Vision Image Understanding (CVIU), vol. 110, 2008, pp. 346-359.
  14. D.G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," Int. J. Comput. Vision, vol. 60, 2004, pp. 91-110. https://doi.org/10.1023/B:VISI.0000029664.99615.94
  15. R. Rogers and J. Lombardo, Android Application Development, 1st ed., Sebastopol, CA: O'Reilly Media, Inc., 2009.
  16. G. Bradski, "The OpenCV Library," Dr. Dobb's J. Softw. Tools, 2000.
  17. X. Liang, S. Zhang, and W. Geng, "Motion-Based Perceptual User Interface," Third Int. Symp. Intell. Inf. Technol. Appl., 2009. pp. 247-251.

Cited by

  1. 어안 영상을 이용한 물체 추적 기반의 한 멀티로봇의 대형 제어 vol.19, pp.6, 2012, https://doi.org/10.5302/j.icros.2013.12.1847
  2. Multi-robot Mapping Using Omnidirectional-Vision SLAM Based on Fisheye Images vol.36, pp.6, 2012, https://doi.org/10.4218/etrij.14.0114.0584
  3. Multi-Robot Avoidance Control Based on Omni-Directional Visual SLAM with a Fisheye Lens Camera vol.19, pp.10, 2018, https://doi.org/10.1007/s12541-018-0173-1