Skip to content

This program is developed to solve the communication barrier between Normal person and specially abled using Deep learning . This Application can be used as virtual camera in any video conference application.

License

Notifications You must be signed in to change notification settings

Deva0813/Real-time-Sign-Language-Translator-Virtual-Camera

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Real-time-Sign-Language-Translator

This program is developed to solve the communication barrier between Normal person and specially abled using Deep learning . This Application can be used as virtual camera in any video conference application.

PROJECT TITLE :

Real-Time Communication System Powered by AI for Specially Abled

RTCS


πŸ‘©β€πŸ’» TEAM ID : PNT2022TMID22290

TEAM DETAILS :

TEAM LEADER   - Devanand M
TEAM MEMBER - Dhinesh M
TEAM MEMBER - Komesh S
TEAM MEMBER - Veluru Balaji


πŸ“„ PROJECT DETAILS

PROJECT DESCRIPTION :

    In our society, we have people with disabilities. The technology is developing day by day but no significant developments are undertaken for the betterment of these people. Communications between deaf-mute and a normal person has always been a challenging task. It is very difficult for mute people to convey their message to normal people. Since normal people are not trained on hand sign language. In emergency times conveying their message is very difficult. The human hand has remained a popular choice to convey information in situations where other forms like speech cannot be used. Voice Conversion System with Hand Gesture Recognition and translation will be very useful to have a proper conversation between a normal person and an impaired person in any language.

    The project aims to develop a system that converts the sign language into a human hearing voice in the desired language to convey a message to normal people, as well as convert speech into understandable sign language for the deaf and dumb. We are making use of a convolution neural network to create a model that is trained on different hand gestures. An app is built which uses this model. This app enables deaf and dumb people to convey their information using signs which get converted to human-understandable language and speech is given as output.

TECHNICAL ARCHITECTURE :

modelCNN


πŸ’Ύ INSTALLATION & OUTPUT PREVIEW

πŸ’Ώ INSTALLATION :

To install required libraries :

pip install -r requirements.txt

To install pytorch :

pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117

To install Nvidia CUDA and CNNtoolkit

Download form the official site

To run the flask app :

python app.py

To run the virtual camera :

python SignCam.py
Note : You have to install OBS software to utilize the functions of virtual sign language camera.

πŸ“€ OUTPUT PREVIEW :

ezgif com-gif-maker

DEMO-SITE : Link (This is just a demo site and the video translate is an illustration of actual convertion and other features works properly.)

Demo Video : Link

About

This program is developed to solve the communication barrier between Normal person and specially abled using Deep learning . This Application can be used as virtual camera in any video conference application.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages