• Proceedings of the IEEK Conference
• /
• 1998.10a
• /
• pp.931-934
• /
• 1998

We have implemented a sign language animation system using 2D and 3D models. From the previous studies, we find out that both models have several limitations based on the linear interpolation and fixed number of frames, and they result in incorrectness of actions and unnatural movements. To solve the problems, in this paper, we propose a sign language animation system using spline interpolation method and variable number of frames. Experimental results show that the proposed method could generate animation more correctly and rapidly than previous methods.

• Proceedings of the IEEK Conference
• /
• 1998.06a
• /
• pp.929-932
• /
• 1998

In this paper we propose a method of representing emotional experessions and lip shapes for sign language communication using 3-dimensional model. At first we employ the action units (AU) of facial action coding system(FACS) to display all shapes. Then we define 11 basic lip shapes and sounding times of each components in a syllable in order to synthesize the lip shapes more precisely for korean characters. Experimental results show that the proposed method could be used efficiently for the sign language image communication between different languages.

• Proceedings of the IEEK Conference
• /
• 1999.06a
• /
• pp.655-658
• /
• 1999

In this paper we design a key-frame editor for 3D sign-language animation using the inverse kinematics. Using the editor, we can calculate the joint angles for two arms automatically. Up to now we have computed the values of the joint angles using the forward kinematics, where we have determined the values heuristically based on our experiences. To overcome the drawbacks, we employ the arm transformation matrix of the inverse kinematics. Experimental results show a possibility that the proposed method could be used for making up the sign-language communication dictionaries.

• Proceedings of the IEEK Conference
• /
• 1998.06a
• /
• pp.925-928
• /
• 1998

In this paper, we implemented a sign language communication system between korean and japanese using 3D model. Unitl now, we have developed the system through 2D image. The system, however, has some drawbacks base don the limitations of 2D model. Especially it is not comprehensive in the sign language gesture including forward or backward movements becasue it can only display a front view. Therefore, we employed a 3D model for the representation of sign language. The proposed communication system si implemented with windows 95 visual C++ 5.0 imported open inventor library on pentium 233 system. Experimented results show that the 3D system can solve the problems in 2D representation.

• The Transactions of the Korea Information Processing Society
• /
• v.7 no.5
• /
• pp.1317-1329
• /
• 2000

The advanced techniques for video processing and computer graphics enables a sign language education system to appear. the system is capable of showing a sign language motion for an arbitrary sentence using the captured video clips of sign language words. In this paper, a method is suggested which generates the frames between the last frame of a word and the first frame of its following word in order to animate hand motion. In our method, we find hand locations and angles which are required for in between frame generation, capture and store the hand images at those locations and angles. The inbetween frames generation is simply a task of finding a sequence of hand angles and locations. Our method is computationally simple and requires a relatively small amount of disk space. However, our experiments show that inbetween frames for the presentation at about 15fps (frame per second) are achieved so tat the smooth animation of hand motion is possible. Our method improves on previous works in which computation cost is relativey high or unnecessary images are generated.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2024.01a
• /
• pp.317-319
• /
• 2024

본 논문에서는 비디오 캡셔닝 알고리즘을 적용한 수어 번역 및 행동 인식 알고리즘을 적용한 수어 인식 알고리즘을 제안한다. 본 논문에 사용된 비디오 캡셔닝 알고리즘으로 40개의 연속된 입력 데이터 프레임을 CNN 네트워크를 통해 임베딩 하고 트랜스포머의 입력으로 하여 문장을 출력하였다. 행동 인식 알고리즘은 랜덤 샘플링을 하여 한 영상에 40개의 인덱스에서 40개의 연속된 데이터에 CNN 네트워크를 통해 임베딩하고 GRU, 트랜스포머를 결합한 RNN 모델을 통해 인식 결과를 출력하였다. 수어 번역에서 BLEU-4의 경우 7.85, CIDEr는 53.12를 얻었고 수어 인식으로 96.26%의 인식 정확도를 얻었다.

• Journal of information and communication convergence engineering
• /
• v.8 no.1
• /
• pp.19-22
• /
• 2010

A finger language helping hearing impaired people in communication A sign language helping hearing impaired people in communication is not popular to ordinary healthy people. In this paper, we propose a method for real-time sign language recognition from a vision system using color information and fuzzy clustering system. We use YCbCr color model and canny mask to decide the position of hands and the boundary lines. After extracting regions of two hands by applying 8-directional contour tracking algorithm and morphological information, the system uses FCM in classifying sign language signals. In experiment, the proposed method is proven to be sufficiently efficient.

• Journal of Biomedical Engineering Research
• /
• v.21 no.6
• /
• pp.591-598
• /
• 2000

본 논문에서는 인터넷 멀티미디어 수화사전 Web-Sign을 설계 및 구현한다. Web-Sign은 여러 가지의 검색조건에 의한 수화동영상을 화면에 출력하고 관련 정보를 쉽게 찾아 볼 수 있는 특징이 있다. 또한 Web-Sign은 100% JAVA로 구현하였기 때문에 플랫폼과 OS의 영향을 거의 받지 않으며, 애플릿과 어플리케이션으로 모두 배포 가능한 장점을 가지고 있다. 웹 브라우저에 의한 접속은 애플릿을 자동으로 지원하며, 어플리케이션을 이용할 경우 모든 데이터는 On-Line 혹은 Off-Line 형태로 전송이 가능하다. 검색방법은 단어입력, 가나다순서별 선택, 동작정보(수위소)선택, 동작화면에 의한 선택, 수화 교과서〔10〕의 챕터순서별로 선택, 주제별 수화분류에 의한 단어선택 등을 이용할 수 있다. 현재까지 등록된 동영상은 현재까지 총 500 여개이며 각 동영상에 대한 시작 및 끝 화면의 정지영상 1000여개와 빠른 전송을 위한 동영상 1000여개를 참고자료로 가지고 있다. 본 논문에서 제안하는 Web-Sign은 많은 검색방법을 가지고 있고, 다양한 정보를 인터넷을 통해 제공할 수 있으므로, 사용자가 쉽게 접근하여 수화를 익힐 수 있을 것으로 판단된다.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.37 no.5
• /
• pp.21-30
• /
• 2000

As a means of getting over the linguistic barrier between different languages, a sign-language communication system using CG animation techniques has been studied. In order to generate a kind of sign-language animation in the system, the joint angles of the arms and the hands corresponding to the gesture have to be determined Up to date, however, the values of joint angles have been decided by trial-and-error methods based on the animator's experiences To overcome the drawback, m this paper, we design an integrated keyframe editor of the arms and the hands for 3D sign-language animation with which we can easily and quickly generate the keyframes of the sign-language animation required to build up In the Implemented keyframe editor, the values of joint angles are calculated by using mverse kinematics, and the same transformation matrix is applied to the joints of two arms and twenty fingers Experimental results show a possibility that the editor could be used efficiently for making up the sign-language communication dictionaries needed for inter-communication between different languages.

• Journal of Korea Multimedia Society
• /
• v.4 no.3
• /
• pp.238-246
• /
• 2001

We have developed the sign-language synthesis system, which can be applied for intelligent terminal equipments, for the purpose of communications between normal people and the hearing-impaired. In the system, we generate the behavior of the sign-language words using CG animation based on Motion-Primitives of the motion observed of each legion of the body in the generation of words, the conventional system was difficult to control the shape of hands and the motions of hands and shoulder, requiring lots of time for the processing. Also it is a big problem to make a large database of sign-language, because it requires over 5,000 words to translate the sign-language. Therefore, in this paper, we propose the new system that is easy to construct the database by using Motion-Primitives, which can make paths of various motions more smooth than conventional systems. We have tested 100 words of the sign-language against the hearing-impaired with the proposed system. As the result of testing by the proposed system, we have earned a good recognition rate with 82%. On the other hand, we had earned the recognition ratio with 76% by using the former system.