Haptics – #sirslab paper published on IEEE Robotics and Automation Letters (RA-L)

Combining wearable finger haptics and Augmented Reality: User evaluation using an external camera and the Microsoft HoloLens

Leonardo Meli, Claudio Pacchierotti , Gionata Salvietti, Francesco Chinello, Maurizio Maisto, Alessandro De Luca, Domenico Prattichizzo.

DOI: 10.1109/LRA.2018.2864354

Abstract.  Augmented Reality (AR) enriches our physical world with digital content and media, such as 3D models and videos, overlaying in real time the camera view of our smartphone, tablet, laptop, or glasses. Despite the recent massive interest for this technology, it is still not possible to receive rich haptic feedback when interacting with augmented environments. This lack is mainly due to the poor diffusion of suitable haptic interfaces, which should be easy to wear, lightweight, compact, and inexpensive. In this paper, we briefly review the state of the art on wearable haptics and its application in AR. Then, we present three AR use cases, considering tasks of manipulation, guidance, and gaming, using both external cameras with standard screens as well as fully-wearable solutions, using the Microsoft HoloLens. We evaluate these tasks enrolling a total of 34 subjects, analyzing performance and user experience when using a 3-DoF wearable device for the fingertip, a 2-DoF wearable device for the proximal finger phalanx, a vibrotactile ring, and a popular sensory substitution technique (interaction force displayed as a colored bar). Results show that providing haptic feedback through the wearable devices significantly improves the performance, intuitiveness, and comfort of the considered AR tasks.

ccc_holo.png

 

A video showing the main concept of the work can be watched here

The pdf of the paper can be downloaded at http://sirslab.dii.unisi.it/papers/2018/Meli18_hololens.pdf

The paper can be cited using the following bibtex item

@article{Meli18_RAL_hololens, 
   Author = {Meli, L. and Pacchierotti, C. and Salvietti, G. and Chinello, F. and Maisto, M. and De Luca, A. and Prattichizzo, D.},
   Title = {Combining wearable finger haptics and Augmented Reality: User evaluation using an external camera and the Microsoft HoloLens},
   Journal = {{IEEE Robotics and Automation Letters}},
   Volume = {3},
   Number = {4},
   Pages = {4297--4304},
   Year = {2018}
}

This work will be presented at the IIEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2018) that is held 1-5 October in Madrid, Spain.

Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s