Conference Papers Year : 2025

Closing the Communication Divide: Enhancing Sign Language Recognition with Gesture-to-Text Conversion Through Computer Vision

R. Krishnakumar
  • Function : Author
  • PersonId : 1561520
M. Kapil
  • Function : Author
  • PersonId : 1561521
V. Muthu Lakshmi
  • Function : Author
  • PersonId : 1561519

Abstract

This paper introduces an innovative method specifically created for identifying and understanding fixed hand movements that represent symbols in American Sign Language (ASL). With the goal of improving communication and learning for those with hearing and speaking difficulties, this system is exceptionally useful for the deaf community to interact with technology. Utilizing the widespread use of ASL as a widely accepted form of communication, the system primarily concentrates on recognizing and converting static hand gestures that correspond to ASL letters into written output. Furthermore, it also includes the ability to convert text to speech, adding to its functionality. At the heart of our groundbreaking approach is the use of Principal Component Analysis (PCA) on still images of the ASL alphabet to accurately detect gestures. By utilizing the power of PCA to identify crucial elements, our system can effectively classify input images and provide accurate recognition of the corresponding ASL alphabet. This output is then presented as text, and can even be transformed into speech, making it a comprehensive tool for individuals with hearing and speech impairments to seamlessly communicate through computer technology. Significantly, this system eliminates the requirement for extra data collecting tools, making it more convenient for users. The strong recognition of ASL gestures, along with the ability to convert those gestures into text and sound, empowers those who are deaf or hard of hearing to effectively communicate through technology.

Embargoed file
Embargoed file
2 0 17
Year Month Jours
Avant la publication
Saturday, January 1, 2028
Embargoed file
Saturday, January 1, 2028
Please log in to request access to the document

Dates and versions

hal-05157411 , version 1 (11-07-2025)

Licence

Identifiers

Cite

R. Krishnakumar, M. Kapil, V. Muthu Lakshmi. Closing the Communication Divide: Enhancing Sign Language Recognition with Gesture-to-Text Conversion Through Computer Vision. 8th International Conference on Computer, Communication, and Signal Processing (ICCCSP), Mar 2024, Chennai, India. pp.213-224, ⟨10.1007/978-3-031-73617-9_17⟩. ⟨hal-05157411⟩
67 View
1 Download

Altmetric

Share

  • More