Drag-and-Drop Interface for Registration-Free Object Delivery

Kentaro Ishii, Yoshiki Takeoka, Masahiko Inami, and Takeo Igarashi

Abstract

We propose a simple drag-and-drop interface on a touch screen to give instructions to an object-delivery robot. The user uses a finger to drag a target object and drop it to a target location on the screen that shows an image of the floor provided by a ceiling camera. The system then autonomously executes a delivery task without continuous control by the user. We employ user-guided computer vision methods to identify and track an object in a scene without prior registration. We conducted a user study, which showed that the participants completed separate tasks more successfully when using our method than when using a remote controller.

Publication

Kentaro Ishii, Yoshiki Takeoka, Masahiko Inami, and Takeo Igarashi,
Drag-and-Drop Interface for Registration-Free Object Delivery,
Proceedings of the 19th IEEE International Symposium in Robot and Human Interactive Communication, RO-MAN2010, pp. 228-233.
　 YouTube