Physically touching and tasting virtual objects enhances the realism of virtual experiences

This study is the first to empirically demonstrate the effectiveness of tactile augmentation as a simple, safe, inexpensive technique with large freedom of motion for adding physical texture, force feedback cues, smell and taste to virtual objects.

Abstract

Experiment 1 explored the impact of physically touching a virtual object on how realistic the virtual environment (VE) seemed to the user. Subjects in a 'no touch' group picked up a 3D virtual image of a kitchen plate in a VE, using a traditional 3D wand. 'See and touch' subjects physically picked up a virtual plate possessing solidity and weight, using a technique called 'tactile augmentation'. Afterwards, subjects made predictions about the properties of other virtual objects they saw but did not interact with in the VE. 'See and touch' subjects predicted these objects would be more solid, heavier, and more likely to obey gravity than the 'no touch' group. In Experiment 2 (a pilot study), subjects 'physically bit' a chocolate bar in one condition, and 'imagined biting' a chocolate bar in another condition. Subjects rated the event more fun and realistic when allowed to physically bite the chocolate bar. Results of the two experiments converge with a growing literature showing the value of adding physical qualities to virtual objects. This study is the first to empirically demonstrate the effectiveness of tactile augmentation as a simple, safe, inexpensive technique with large freedom of motion for adding physical texture, force feedback cues, smell and taste to virtual objects. Examples of practical applications are discussed.