Vision for Robust Robot Manipulation

Please use this identifier to cite or link to this item:
Información del item - Informació de l'item - Item information
Title: Vision for Robust Robot Manipulation
Authors: Martinez-Martin, Ester | Pobil, Angel P. del
Research Group/s: Robótica y Visión Tridimensional (RoViT)
Center, Department or Service: Universidad de Alicante. Departamento de Ciencia de la Computación e Inteligencia Artificial
Keywords: Robotics | Robot manipulation | Depth vision
Knowledge Area: Ciencia de la Computación e Inteligencia Artificial
Issue Date: 6-Apr-2019
Publisher: MDPI
Citation: Martinez-Martin E, del Pobil AP. Vision for Robust Robot Manipulation. Sensors. 2019; 19(7):1648. doi:10.3390/s19071648
Abstract: Advances in Robotics are leading to a new generation of assistant robots working in ordinary, domestic settings. This evolution raises new challenges in the tasks to be accomplished by the robots. This is the case for object manipulation where the detect-approach-grasp loop requires a robust recovery stage, especially when the held object slides. Several proprioceptive sensors have been developed in the last decades, such as tactile sensors or contact switches, that can be used for that purpose; nevertheless, their implementation may considerably restrict the gripper’s flexibility and functionality, increasing their cost and complexity. Alternatively, vision can be used since it is an undoubtedly rich source of information, and in particular, depth vision sensors. We present an approach based on depth cameras to robustly evaluate the manipulation success, continuously reporting about any object loss and, consequently, allowing it to robustly recover from this situation. For that, a Lab-colour segmentation allows the robot to identify potential robot manipulators in the image. Then, the depth information is used to detect any edge resulting from two-object contact. The combination of those techniques allows the robot to accurately detect the presence or absence of contact points between the robot manipulator and a held object. An experimental evaluation in realistic indoor environments supports our approach.
Sponsor: This research was partially funded by Ministerio de Economía y Competitividad grant number DPI2015-69041-R.
ISSN: 1424-8220
DOI: 10.3390/s19071648
Language: eng
Type: info:eu-repo/semantics/article
Rights: © 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (
Peer Review: si
Publisher version:
Appears in Collections:INV - RoViT - Artículos de Revistas

Files in This Item:
Files in This Item:
File Description SizeFormat 
Thumbnail2019_Martinez_del-Pobil_Sensors.pdf24,17 MBAdobe PDFOpen Preview

This item is licensed under a Creative Commons License Creative Commons