Journal of KIISE:Software and Applications (한국정보과학회논문지:소프트웨어및응용)

Korean Institute of Information Scientists and Engineers (한국정보과학회)
권호 표지

Handwriting and Voice Input using Transparent Input Overlay

투명한 입력오버레이를 이용한 필기 및 음성 입력

  • 김대현 (이화여자대학교 디지털미디어학부) ;
  • 김명준 (이화여자대학교 디지털미디어학부) ;
  • 이진호 ((주)알티캐스트 델타프로젝트팀)
  • Published : 2008.04.15
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes a unified multi-modal input framework to interface the recognition engines such as IBM ViaVoice and Microsoft handwriting-recognition system with general window applications, particularly, for pen-input displays. As soon as user pushes a hardware button attached to the pin-input display with one hand, the current window of focus such as a internet search window and a word processor is overlaid with a transparent window covering the whole desktop; upon which user inputs handwriting with the other hand, without losing the focus of attention on working context. As well as freeform handwriting on this transparent input overlay as a sketch pad, the user can dictate some words and draw diagrams to communicate with the system.

본 논문은 IBM ViaVoice와 마이크로소프트 필기-인식 시스템(handwriting-recognition system)과 같은 인식 엔진(recognition engines)을 UMPC와 같은 펜-입력 디스플레이에서 작동하는 일반적인 윈도우 어플리케이션과 연동하기 위한 단일화된 멀티모달 입력 프레임워크(unified multi-modal input framework)를 제안한다. 사용자가 펜-입력 디스플레이에 부탁되어있는 버튼을 한 손으로 누르면, 인터넷 검색 윈도우나 워드 프로세서와 같이 현재 포커스를 갖는 윈도우는 전체 데스크탑을 덮을 수 있는 투명한 윈도우로 덮여진다. 이 위에 사용자는 다른 한 손으로, 현재 working context를 놓치지 않으면서, 필기 입력을 자유롭게 수행할 수 있다. 이런 투명 입력 윈도우를 이용하여 필기 및 음성 입력뿐만 아닐라 다이어그램까지 그릴 수 있게 해준다.

Keywords

References

  1. Baumgarten. IBMrViaVoice QuickTutorial. South- Western Educational Publishing
  2. Jeff Van West. Using Tablet PC: Handwriting Recognition. Microsoft, 2007
  3. Clive Frankish, Richard Hull, and Pam Morgan. Recognition accuracy and user acceptance of pen interfaces. In CHI 1995 Proceedings, pages 12-18, 1995
  4. Jennifer Mankoff, Scott E. Hudson, and Gregory D. Abowd. Interaction techniques for ambiguity resolution in recognition-based interfaces. In Proceedings of the 13th annual ACM symposium or User Interface software and technology, pages 11-20. ACM, November 2000
  5. Richard C. Davis, James A. Landay, Victor Chen, Jonathan Huang, Rebecca B. Lee, Francis C. Li, James Lin, Charles B. Morrey III, Ben Schleimer, Morgan N. Price, and Bill N. Schilit. Notepals: lightweight note sharing by the group, for the group. In Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, pages 338-345, 1999
  6. Thomas P. Moran, Patric Chiu, William van Melle, and Gordon Kurtenbach. Implicit structures for pen-based systems within a freeform interaction paradigm. In Proceedings of ACM CHI'95 Conference on Human Factors in Computing Systems, pages 487-494, 1995
  7. Gordon Kurtenbach, George Fitzmaurice, Thomas Baudel, and Bill Buxton. The design of a gui paradigm based on tablets, two-hands, and transparency. In Proceedings of the 1997 ACM Conference on Human Factors in Computing Systems, pages 35-42, 1997
  8. Dae Hyun Kim and Myoung-Jun Kim. A new modeling interface for the peninput displays. Journal of Computer-Aided Design, 38(3):210-223, 2006 https://doi.org/10.1016/j.cad.2005.10.007
  9. L.M. Encarnacao, O. Bimber, D. Schmalstieg, and S.D. Chandler. A transluccent sketchpad for the virtual table exploring motion-based gesture recognition. Graphics Forum, 18(3):C277-C285, 1999 https://doi.org/10.1111/1467-8659.00348
  10. Jitsuro Mase. Moderato: 3d sketch cad with quick positioned working plane and texture modeling. In T.-M. Rhyne A. Chalmers, editor, eCAADe2000, Bauhaus-Universitat Weimar, pages 300-307, June 2000
  11. M. Trinder. The computer's role in sketch design: A transparent sketching medium. In Computers and Building, Proc CAADfutures99, pages 227-244, Atlanta, 1999
  12. William Buxton. Chunking and phrasing and the design of human-computer dialogues. Information processing, pages 1285-1291, 1986