YS216: Handslate: Bridging The Gap Between The Deaf, Mute And Hearing

Neoh Yi Qing SMJK Perempuan China Pulau Pinang

VIC26 | Young Scientist

CR: 0.0000 | 0 Likes | 2 Views | 1 times | LS: 1.0
Like it? | Support them now!

There is a language barrier between the deaf/mute, and hearing. Time is ticking. WHO estimated that by 2050 over 700 million people will have disabling hearing loss. Barriers such as inaccessibility to ASL courses are become more and more apparant.


Handslate is a two-way application that detects sign language signed out by deaf and mute people, then translates the signs into readable words and spoken voiceovers. It can also convert speech to text easily! It detects the words of the hearing person and turns it into text.

This program uses CV for gesture recognition, and NLPs for speech recognition and text to speech.

The speech_recognition library was used for the speech-to-text operations. The 
STT interface was made with Tkinter. I am running this on a laptop with an Intel(R) Core and an Intel(R)UHD Graphics video card.

Handslate can break the language barrier between the deaf, mute and hearing people, resulting in less misunderstandings and more meaningful conversations.