Realization and Implementation of Communication for Hearing Impaired & Inarticulate People
Natural Language Processing (NLP) is an emerging field that helps convey information and meaning with semantic cues such as words, signs, or images. Sign language is a very convenient way for hearing impaired and inarticulate people. But for the others, communication with hearing impaired and inarticulate people is difficult because a person with no disabilities cannot understand their sign language in normal circumstances. This difference in society can be minimized if we can program a machine/device in such a way that it translates sign language into text or speech. The project mainly consists of two parts, i.e., sign-to-speech conversion and mobile application development. The sign will be recorded in videos that include sentences from daily life activities and emergency situations in sign-to-speech conversion. The sign is recognized with the help of computer vision, image processing, and machine learning algorithms. It is then converted into text, and text will be used to generate speech. The purpose is to develop a system that can convert sign language into textual and audio form with a mobile application interface, thereby reducing the communication barrier between abled and specially-abled people. It is a reliable alternate mode of communication that does not need any speaking abilities and is necessary for individuals suffering from hearing and speech disabilities to improve their quality of life. This project aims to address United Nations’ Sustainable Development Goals (SDGs) 8.5, 10.2, and 10.3. This project aims to increase productive employment opportunities for people with hearing and speaking disabilities. Moreover, people with no disabilities will also be able to use this mobile application to understand the sign language of disabled people.
Keywords: Machine Learning,Image Processing,Computer Vision,Mobile Application Development
Tools: Python,Java,Google Colab,Android Studio
Department: Department of Electrical Engineering
Project Team Members
| Name |
Email |
|
Muhammad Faizan Ikram
|
faizanikram22@gmail.com |
|
Tanzila Iram
|
tanzilairam014@gmail.com |
Project Poster
