Accurate and efficient 3D hand pose regression for robot hand teleoperation using a monocular RGB camera
Por favor, use este identificador para citar o enlazar este ítem:
http://hdl.handle.net/10045/93916
Título: | Accurate and efficient 3D hand pose regression for robot hand teleoperation using a monocular RGB camera |
---|---|
Autor/es: | Gomez-Donoso, Francisco | Orts-Escolano, Sergio | Cazorla, Miguel |
Grupo/s de investigación o GITE: | Robótica y Visión Tridimensional (RoViT) |
Centro, Departamento o Servicio: | Universidad de Alicante. Departamento de Ciencia de la Computación e Inteligencia Artificial | Universidad de Alicante. Instituto Universitario de Investigación Informática |
Palabras clave: | Hand pose estimation | Deep learning | Robot teleoperation | Monocular |
Área/s de conocimiento: | Ciencia de la Computación e Inteligencia Artificial |
Fecha de publicación: | 1-dic-2019 |
Editor: | Elsevier |
Cita bibliográfica: | Expert Systems with Applications. 2019, 136: 327-337. doi:10.1016/j.eswa.2019.06.055 |
Resumen: | In this paper, we present a novel deep learning-based architecture, which is under the scope of expert and intelligent systems, to perform accurate real-time tridimensional hand pose estimation using a single RGB frame as an input, so there is no need to use multiple cameras or points of view, or RGB-D devices. The proposed pipeline is composed of two convolutional neural network architectures. The first one is in charge of detecting the hand in the image. The second one is able to accurately infer the tridimensional position of the joints retrieving, thus, the full hand pose. To do this, we captured our own large-scale dataset composed of images of hands and the corresponding 3D joints annotations. The proposal achieved a 3D hand pose mean error of below 5 mm on both the proposed dataset and Stereo Hand Pose Tracking Benchmark, which is a public dataset. Our method also outperforms the state-of-the-art methods. We also demonstrate in this paper the application of the proposal to perform a robotic hand teleoperation with high success. |
Patrocinador/es: | This work has been supported by the Spanish Government TIN2016-76515R Grant, supported with Feder funds. This work has also been supported by a Spanish grant for PhD studies ACIF/2017/243 |
URI: | http://hdl.handle.net/10045/93916 |
ISSN: | 0957-4174 (Print) | 1873-6793 (Online) |
DOI: | 10.1016/j.eswa.2019.06.055 |
Idioma: | eng |
Tipo: | info:eu-repo/semantics/article |
Derechos: | © 2019 Elsevier Ltd. |
Revisión científica: | si |
Versión del editor: | https://doi.org/10.1016/j.eswa.2019.06.055 |
Aparece en las colecciones: | INV - RoViT - Artículos de Revistas |
Archivos en este ítem:
Archivo | Descripción | Tamaño | Formato | |
---|---|---|---|---|
2019_Gomez-Donoso_etal_ExpertSystWithAppl_final.pdf | Versión final (acceso restringido) | 3,35 MB | Adobe PDF | Abrir Solicitar una copia |
2019_Gomez-Donoso_etal_ExpertSystWithAppl_accepted.pdf | Accepted Manuscript (acceso abierto) | 10,07 MB | Adobe PDF | Abrir Vista previa |
Todos los documentos en RUA están protegidos por derechos de autor. Algunos derechos reservados.