International Journal of Computer Science & Network Security

International Journal of Computer Science & Network Security (국제컴퓨터통신보호논문지학회)
권호 표지
DOI QR코드

DOI QR Code

Speech Generation Using Kinect Devices Using NLP

  • D. Suganthi (College of Engineering, Anna University, Guindy Campus)
  • Received : 2024.02.05
  • Published : 2024.02.29
Download PDF
⟨ Previous Next ⟩

Abstract

Various new technologies and aiding instruments are always being introduced for the betterment of the challenged. This project focuses on aiding the mute in expressing their views and ideas in a much efficient and effective manner thereby creating their own place in this world. The proposed system focuses on using various gestures traced into texts which could in turn be transformed into speech. The gesture identification and mapping is performed by the Kinect device, which is found to cost effective and reliable. A suitable text to speech convertor is used to translate the texts generated from Kinect into a speech. The proposed system though cannot be applied to man-to-man conversation owing to the hardware complexities, but could find itself very much of use under addressing environments such as auditoriums, classrooms, etc

Keywords

References

  1. Mauro dos Santos Anjo, Ednaldo Brigante Pizzolato, Sebastian Feuerstack "A Real-Time System to Recognize Static Gestures of Brazilian Sign Language (Libras) alphabet using Kinect", IHC 2012 proceedings.
  2. K. K. Biswas and Saurav Kumar Basu "Gesture Recognition using Microsoft Kinect", 2012, unpublished.
  3. Yi Li "Hand Recognition using Kinect", 2012, unpublished.
  4. Belinda Lange, Skip Rizzo, Chien Yen Chang, Evan A. Suma, Mark "Markerless Full Body Tracking: Depth-.Sensing Technology within Virtual Environments", Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC), 2011.
  5. Mohamed Alsheakhali, Ahmed Skaik, Mohammed Aldahdouh and Mahmoud Alhelou "Hand Gesture Recognition System", 2011, Intelligent Approaches to interact with Machines proceedings.
  6. Ankit Chaudhary, J. L. Raheja, Karen Das, Sonia Raheja, "Using Hand Gesture Recognition in Natural way: A Survey", International Journal of Computer Science & Engineering Survey (IJCSES) Vol.2, No.1, Feb 2011.
  7. Archana S. Ghotkar and Gajanan K. Kharate, "Hand Segmentation Techniques to Hand Gesture Recognition for Natural Human Computer Interaction", International Journal of Human Computer Interaction (IJHCI), Volume (3): Issue (1), 2012.
  8. Xi Chen and Markus Koskela, "Skeleton-Based Action Recognition with Extreme Learning Machines", ELM2013 23 October 2013.
  9. Chanjira Sinthanayothin, Nonlapas Wongwaen and Wisarut Bholsithi, "Skeleton Tracking using Kinect Sensor & Displaying in 3D Virtual Scene", International Journal of Advancements in Computing Technology(IJACT), Volume4, Number11, June 2012.
  10. Georgios Th. Papadopoulos, Apostolos Axenopoulos and Petros Daras, "Real-time Skeleton-tracking-based Human, Action Recognition Using Kinect Data", 2013.
  11. Abhishek Kar, "Skeletal Tracking using Microsoft Kinect", 2013, unpublished.
  12. Najeefa Nikhat Choudhury and Golam Kayas,"Automatic Recognition of Bangla Sign Language",2012, unpublished.
  13. G Tao, PS Archambault and MF Levin, "Evaluation of Kinect skeletal tracking in a virtual reality rehabilitation system for upper limb hemiparesis", Virtual Rehabilitation (ICVR), 2013.
  14. Alessandro De Mauro, "Virtual Reality Based Rehabilitation and Game Technology", EICS4Med, 2011.
  15. Jiann-Der Lee, Chung-Hung Hsieh and Ting-Yang Lin, "A Kinect-based Tai Chi exercises evaluation system for physical rehabilitation", Consumer Electronics (ICCE), 2014.
  16. Bengalur, "Human activity recognition using body pose features and support vector machine", Advances in Computing, Communications and Informatics (ICACCI), 2013.
  17. Helten T. Muller M. Seidel H. P. and Theobalt, C., "Real-Time Body Tracking with One Depth Camera and Inertial Sensors", Computer Vision (ICCV), 2013.