Sign4all: A Low-Cost Application for Deaf People Communication

Please use this identifier to cite or link to this item: http://hdl.handle.net/10045/137062
Información del item - Informació de l'item - Item information
Title: Sign4all: A Low-Cost Application for Deaf People Communication
Authors: Morillas-Espejo, Francisco | Martinez-Martin, Ester
Research Group/s: Robótica y Visión Tridimensional (RoViT)
Center, Department or Service: Universidad de Alicante. Departamento de Ciencia de la Computación e Inteligencia Artificial
Keywords: Virtual avatar | Sign language | Computer vision | Teaching system
Issue Date: 6-Sep-2023
Publisher: IEEE
Citation: IEEE Access. 2023, 11: 98776-98786. https://doi.org/10.1109/ACCESS.2023.3312636
Abstract: One of the main barriers for deaf people is communication due to the lack of understanding between them and the hearing society. This fact can considerably affect their daily life by leading to their social exclusion. On the way to an inclusive society, this paper presents a low-cost application to assist people to communicate by means of the Sign Language alphabet. For that, this application includes two functionalities: (1) a Sign Language recognizer, which is in charge of typing the letters being signed by deaf people; and, (2) a virtual avatar signing what is written letter by letter. So, a comparative analysis of different techniques resulted in an accuracy of 79.96% when using the Convolutional Neural Network ResNet50 for sign recognition from an RGB image.
Sponsor: This work has been funded by a PhD grant under the reference UAFPU21-78 from the University of Alicante (Spain).
URI: http://hdl.handle.net/10045/137062
ISSN: 2169-3536
DOI: 10.1109/ACCESS.2023.3312636
Language: eng
Type: info:eu-repo/semantics/article
Rights: This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. For more information, see https://creativecommons.org/licenses/by-nc-nd/4.0/
Peer Review: si
Publisher version: https://doi.org/10.1109/ACCESS.2023.3312636
Appears in Collections:INV - RoViT - Artículos de Revistas

Files in This Item:
Files in This Item:
File Description SizeFormat 
ThumbnailMorillas-Espejo_Martinez-Martin_2023_IEEEAccess.pdf1,73 MBAdobe PDFOpen Preview


This item is licensed under a Creative Commons License Creative Commons