A long short‐term memory based Schaeffer gesture recognition system
Por favor, use este identificador para citar o enlazar este ítem:
http://hdl.handle.net/10045/75096
Título: | A long short‐term memory based Schaeffer gesture recognition system |
---|---|
Autor/es: | Oprea, Sergiu | Garcia-Garcia, Alberto | Orts-Escolano, Sergio | Villena Martínez, Víctor | Castro-Vargas, John Alejandro |
Grupo/s de investigación o GITE: | Robótica y Visión Tridimensional (RoViT) |
Centro, Departamento o Servicio: | Universidad de Alicante. Departamento de Tecnología Informática y Computación | Universidad de Alicante. Departamento de Ciencia de la Computación e Inteligencia Artificial |
Palabras clave: | Gesture recognition | Recurrent neural networks | Schaeffer language |
Área/s de conocimiento: | Arquitectura y Tecnología de Computadores | Ciencia de la Computación e Inteligencia Artificial |
Fecha de publicación: | abr-2018 |
Editor: | John Wiley & Sons |
Cita bibliográfica: | Expert Systems. 2018, 35(2): e12247. doi:10.1111/exsy.12247 |
Resumen: | In this work, a Schaeffer language recognition system is proposed in order to help autistic children overcome communicative disorders. Using Schaeffer language as a speech and language therapy, improves children communication skills and at the same time the understanding of language productions. Nevertheless, the teaching process of children in performing gestures properly is not straightforward. For this purpose, this system will teach children with autism disorder the correct way to communicate using gestures in combination with speech reproduction. The main purpose is to accelerate the learning process and increase children interest by using a technological approach. Several recurrent neural network‐based approaches have been tested, such as vanilla recurrent neural networks, long short‐term memory networks,and gated recurrent unit‐based models. In order to select the most suitable model, an extensive comparison has been conducted reporting a 93.13% classification success rate over a subset of 25 Schaeffer gestures by using an long short‐term memory‐based approach. Our dataset consists on pose‐based features such as angles and euclidean distances extracted from the raw skeletal data provided by a Kinect v2 sensor. |
Patrocinador/es: | This work has been funded by the Spanish Government TIN2016-76515-R grant for the COMBAHO project, supported with Feder funds. This work has also been supported by a Spanish national grant for PhD studies FPU15/04516 and the grant "Ayudas para Estudios de Máster e Iniciación a la Investigación" from the University of Alicante. Experiments were made possible by a generous hardware donation from NVIDIA (Tesla K40). |
URI: | http://hdl.handle.net/10045/75096 |
ISSN: | 0266-4720 (Print) | 1468-0394 (Online) |
DOI: | 10.1111/exsy.12247 |
Idioma: | eng |
Tipo: | info:eu-repo/semantics/article |
Derechos: | © 2017 John Wiley & Sons, Ltd. |
Revisión científica: | si |
Versión del editor: | https://doi.org/10.1111/exsy.12247 |
Aparece en las colecciones: | INV - RoViT - Artículos de Revistas |
Archivos en este ítem:
Archivo | Descripción | Tamaño | Formato | |
---|---|---|---|---|
2018_Oprea_etal_ExpertSystems_final.pdf | Versión final (acceso restringido) | 1,54 MB | Adobe PDF | Abrir Solicitar una copia |
Todos los documentos en RUA están protegidos por derechos de autor. Algunos derechos reservados.