İşitme ve Konuşma Engelli Bireyler için İşaret Tanıma Sistemi Geliştirme
Development of Sign Recognition System for Hearing and Speech Impaired Individuals

Summary/Abstract: Sign language is the movements of the hand, the movements of the fingers, the arms or the movement of the body simultaneously with the face expressions to convey the ideas of the speaker. In recent years, the sign language is in the eyes of all researchers. It is possible to recognize the movements made with the help of sensors. However, it is of great importance to transfer the motion data to computer systems. As a result of the field study, it was determined that the studies conducted in this field were not sufficient at all. It was also found that the studies conducted were mainly in the field of the American Sign Language, the English Sign Language and the Arab Sign Language, and sufficient studies were not done in Turkish Sign Language. In this study, an intelligent system has been developed to facilitate the communication of hearing and speech impaired individuals with other individuals. The work done in this field is thought to help to remove the lack of information in this field. In the intelligent system developed in this Thesis, 33 basic signs in the Turkish Sign Language, which are called as sound informatics are taken as a basis in the study. The developed system uses the Microsoft Kinect v2 sensor to identify the signals. C# programming language and MongoDB are used in the developed system. As a result of the case study, 85% of the 33 basic signs were correctly recognized by the developed system. It is considered that the developed Sign Language recognition system should help both the hearing and speech impaired individuals, and also other individuals, and hopefully solve the problems of communication between these individuals.

• Details
• Contents