HANDSHAPE CLASSIFICATION IN A REVERSE DICTIONARY OF SIGN LANGUAGES FOR THE DEAF

Loading...
Thumbnail Image

Date

2021-03

Authors

Abutalipov, Alikhan
Janaliyeva, Aigerim
Mukushev, Medet
Cerone, Antonio

Journal Title

Journal ISSN

Volume Title

Publisher

From Data to Models and Back

Abstract

This paper showcases the work that aims at building a userfriendly mobile application of a reverse dictionary to translate sign languages to spoken languages. The concept behind the reverse dictionary is the ability to perform a video-based search by demonstrating a handshape in front of a mobile phone’s camera. The user would be able to use this feature in two ways. Firstly, the user would be able to search for a word by showing a handshape for the application to provide a list of signs that contain that handshape. Secondly, the user could fingerspell the word letter by letter in front of the camera for the application to return the sign that corresponds to that word. The user can then look through the suggested videos and see their written translations. To offer other functionalities, the application also has Search by Category and Search by Word options. Currently, the reverse dictionary supports translations from Russian Sign Language (RSL) to Russian language.

Description

Keywords

Type of access: Open Access, Reverse dictionary, Sign language dictionary, Fingerspelling recognition, Video-based search interface, Human-computer interaction, iOS application, Russian Sign Language (RSL)

Citation

Abutalipov, A., Janaliyeva, A., Mukushev, M., Cerone, A., & Sandygulova, A. (2021). Handshape Classification in a Reverse Dictionary of Sign Languages for the Deaf. From Data to Models and Back, 217–226. https://doi.org/10.1007/978-3-030-70650-0_14

Collections