Overview
- iGest Recognito' stands for 'Intelligent Gesture Recognition'.
- An android application to create a communication media in sign language.
- Includes an American Sign Language Keyboard and a media player with American Sign Language (ASL) subtitle feature.
- Also incorporates an alphabetical gesture pattern recognition feature.
Motivation
- We have thought of developing a project with Natural Language Processing (NLP) feature.
- Sign Language Processing is one of the field of our interest because it reveals an opportunity to work with text to sign language conversion and vice-versa.
Modes
- Normal Mode for the features related to American Sign Language
- Communication Mode is the chatting option for the users of this application
Start Page
- According to statistics, Approx. 1 million people of the world are said to be born deaf as well as mute
- Idea of an Android Application which incorporates American Sign Language as a tool for communication of dumb and deaf people.
Menu
- Manifests the features
- Features create a platform of processing Natural Language in Sign Language form to Alphabetic Text form.
Amit Roy, Saif Mahmud, Tauhid Tanjim, Sarker Tanveer Ahmed Rumee, Md. Mofijul Islam
Department. of Computer Science and Engineering, University of Dhaka�
iGest Keyboard
- Keyboard with American Sign Language layout
`
Sign Subtitle
- Media Player with File Selector for Video File and Subtitle file
- Includes Subtitle in American Sign Language
iGesture
- Takes input from the drawn pattern in the screen
- Converts it into corresponding Alphabetic Text
- Prediction done using Gesture Builder ML
Future Ideas
- Evaluate the accuracy and improve our features.
- Make it more user friendly.
- Add a feature of real time hand gesture detection, to ease live communication between disabled and enabled people.
Published as a poster on International conference on Emerging technologies in data Mining and Information Security (IEMIS), 2018, Kolkata, India.
Github Repo: https://github.com/AmitRoy7781/iGestRecognito
iVoice
- Voice Recognition using Google Voice API
- Converts voice input into corresponding alphabetic text and sign
Text to Sign
- Takes alphabetic text input
- Converts into American Sign Language
Sign Tutorial
- Sign Language is a great tool for communicating with disable persons
- iGest Tutorial facilitate the user to learn American Sign Language
Communication Mode
- Chatting with other users of this Application
- Sign-Up and Log-In done using FIrebase