HANDSHAPE CLASSIFICATION IN A REVERSE DICTIONARY OF SIGN LANGUAGES FOR THE DEAF
Loading...
Date
2021-03
Authors
Abutalipov, Alikhan
Janaliyeva, Aigerim
Mukushev, Medet
Cerone, Antonio
Journal Title
Journal ISSN
Volume Title
Publisher
From Data to Models and Back
Abstract
This paper showcases the work that aims at building a userfriendly mobile application of a reverse dictionary to translate sign languages to spoken languages. The concept behind the reverse dictionary
is the ability to perform a video-based search by demonstrating a handshape in front of a mobile phone’s camera. The user would be able to
use this feature in two ways. Firstly, the user would be able to search
for a word by showing a handshape for the application to provide a list
of signs that contain that handshape. Secondly, the user could fingerspell the word letter by letter in front of the camera for the application
to return the sign that corresponds to that word. The user can then
look through the suggested videos and see their written translations. To
offer other functionalities, the application also has Search by Category
and Search by Word options. Currently, the reverse dictionary supports
translations from Russian Sign Language (RSL) to Russian language.
Description
Keywords
Type of access: Open Access, Reverse dictionary, Sign language dictionary, Fingerspelling recognition, Video-based search interface, Human-computer interaction, iOS application, Russian Sign Language (RSL)
Citation
Abutalipov, A., Janaliyeva, A., Mukushev, M., Cerone, A., & Sandygulova, A. (2021). Handshape Classification in a Reverse Dictionary of Sign Languages for the Deaf. From Data to Models and Back, 217–226. https://doi.org/10.1007/978-3-030-70650-0_14