Distant freehand pointing and clicking on very large, high resolution displays
Published 23 October 2005Open access
Daniel Vogel, Ravin Balakrishnan
Citations422
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Three techniques for gestural pointing and two for clicking are developed and evaluated and subtle auditory and visual feedback techniques are presented to compensate for the lack of kinesthetic feedback in freehand interaction.
Abstract
We explore the design space of freehand pointing and clicking interaction with very large high resolution displays from a distance. Three techniques for gestural pointing and two for clicking are developed and evaluated. In addition, we present subtle auditory and visual feedback techniques to compensate for the lack of kinesthetic feedback in freehand interaction, and to promote learning and use of appropriate postures.
Keywords
Computer ScienceNeuroscience
Journal of Experimental Psychology GeneralThe information capacity of the human motor system in controlling the amplitude of movement.
6,321 Citations1992Paul M. Fitts
The experiments reported in the present paper extend the theory to the human motor system, including the visual and proprioceptive feedback loops that permit S to monitor his own activity and create an experimental situation in which it is reasonable to assume that performance is limited primarily by the capacity of the motor system.
Human-Computer InteractionFitts' Law as a Research and Design Tool in Human-Computer Interaction
1,586 Citations1992I. Scott MacKenzie
The present study provides a historical and theoretical context for the Fitts' law model, including an analysis of problems that have emerged through the systematic deviation of observations from predictions.
“Put-that-there”
1,432 Citations1980Richard A. Bolt
The work described herein involves the user commanding simple shapes about a large-screen graphics display surface, and because voice can be augmented with simultaneous pointing, the free usage of pronouns becomes possible, with a corresponding gain in naturalness and economy of expression.
An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments
702 Citations1997Doug A. Bowman, Larry F. Hodges
This work presents implementations and discussion of six techniques which allow manipulation of remote objects which provide distinct advantages in terms of ease of use and efficiency because they consider the tasks of grabbing and manipulation separately.
Manual and gaze input cascaded (MAGIC) pointing
659 Citations1999Shumin Zhai, Carlos H. Morimoto +1 more
This work explores a new direction in utilizing eye gaze for computer input by proposing an alternative approach, dubbed MAGIC (Manual And Gaze Input Cascaded) pointing, which might offer many advantages, including reduced physical effort and fatigue as compared to traditional manual pointing, greater accuracy and naturalness than traditional gaze pointing, and possibly fasterspeed than manual pointing.
Interactive public ambient displays
648 Citations2004Daniel Vogel, Ravin Balakrishnan
Design principles and an interaction framework for sharable, interactive public ambient displays that support the transition from implicit to explicit interaction with both public and personal information are developed.
Image plane interaction techniques in 3D immersive environments
417 Citations1997Jeffrey S. Pierce, Andrew Forsberg +4 more
This paper presents a set of interaction techniques for use in headtracked immersive virtual environments that can be used for object selection, object manipulation, and user navigation in virtual environments.
A survey of design issues in spatial input
356 Citations1994Ken Hinckley, Randy Pausch +2 more
A survey of design issues for developing effective free-space three-dimensional (3D) user interfaces, including the use of spatial references, relative gesture, two-handed interaction, multisensory feedback, physical constraints, and head tracking is presented.
Interacting at a distance
279 Citations2002Brad A. Myers, Rishi Bhatnagar +5 more
It is found that tapping directly on a wall-size SmartBoard was the fastest and most accurate method, followed by a new interaction technique that copies the area of interest from the big screen to a handheld.
Laser pointer interaction
247 Citations2001Dan R. Olsen, Travis Nielsen
A technique using a laser pointer and a camera to accomplish interactions at a distance from a display surface for navigation and entry of numbers, times, dates, text, enumerations and lists of items is described.
Voodoo dolls
230 Citations1999Jeffrey S. Pierce, Brian Stearns +1 more
The Voodoo Dolls technique is a two-handed interaction technique for manipulating objects at a distance in immersive virtual environments that allows both visible and occluded objects to be selected, and provides a stationary frame of reference for working relative to moving objects.
ACM Transactions on Computer-Human InteractionReaching for objects in VR displays
227 Citations1994Colin Ware, Ravin Balakrishnan
The results from three experimental studies of reaching behavior in a head-coupled stereo display system with a hand-tracking subsystem for object selection are reported, finding that lag in the head-tracking system is relatively unimportant in predicting performance, whereaslag in the hand- tracking system is critical.
Multi-finger gestural interaction with 3d volumetric displays
169 Citations2004Tovi Grossman, Daniel Wigdor +1 more
These techniques leverage the unique features of volumetric displays, including a 360° viewing volume that enables manipulation from any viewpoint around the display, as well as natural and accurate perception of true depth information in the displayed 3D scene.
ACM SIGGRAPH Computer GraphicsUser performance in relation to 3D input device design
167 Citations1998Shumin Zhai
The usability of various six degrees of freedom (6 DOF) input devices for 3D user interfaces is reviewed at an introductory and practical level, with pointers to more technical and theoretical references.
Pointing gesture recognition based on 3D-tracking of face, hands and head orientation
149 Citations2003Kai Nickel, Rainer Stiefelhagen
A system capable of visually detecting pointing gestures and estimating the 3D pointing direction in real-time and using head orientation as an additional feature, which observed significant gains in both recall and precision of pointing gestures.
Laser Pointers as Collaborative Pointing Devices
126 Citations2002Jiyoung Oh, Wolfgang Stürzlinger
Laser pointers are presented as input devices that can provide concurrent input streams ideally required to the SDG environment and a new system that uses multiple computer controlled laser pointers as interaction devices for one or more displays is described.
Gaze-orchestrated dynamic windows
125 Citations1981Richard A. Bolt
The intent of the reported research is to introduce order and control, through the creation of a dynamic, gaze-interactive interface to help the observer to cope with the onslaught of events, yet enable on the other hand continuing close contact with that everchanging ensemble.
Lecture notes in computer scienceAn Evaluation of Two Input Devices for Remote Pointing
111 Citations2001I. Scott MacKenzie, Shaidah Jusoh
Using the ISO metric throughput (calculated from users' speed and accuracy in completing tasks) as the criterion, the two remote pointing devices performed poorly, demonstrating 32% and 65% worse performance than the mouse.
EyeWindows
99 Citations2005David Fono, Roel Vertegaal
An attentive windowing technique that uses eye tracking, rather than manual pointing, for focus window selection, is presented, suggesting that zooming windows outperform static tiled windows by about 30% and this performance gain scaled with the number of windows used.
Journal of Visual Languages & ComputingManipulating Objects in Virtual Worlds: Categorization and Empirical Evaluation of Interaction Techniques
86 Citations1999Ivan Poupyrev, Tadao Ichikawa
This work survey and categorize current virtual manipulation techniques according to their basic design metaphors, conduct experimental studies of the most basic techniques, and derive guidelines to aid designers in the practical development of VE applications.
Dictionary of Optometry and Visual Science
75 Citations1997Michel Millodot
This dictionary contains more than 3800 terms used in visual science and optometric practice, each provided with clear definitions, and in most cases with clinical advice.
The role of contextual haptic and visual constraints on object manipulation in virtual environments
67 Citations2000Yanqing Wang, Christine L. MacKenzie
An experiment was conducted to investigate the role of surrounding haptic and visual information on object manipulation in a virtual environment and it was found that the contextual haptic constraints dramatically increased object manipulation speed, but slightly reduced spatial accuracy, compared to free space.
Graphics InterfaceTractorBeam: seamless integration of local and remote pointing for tabletop displays
59 Citations2005Jim Parker, Regan L. Mandryk +1 more
The TractorBeam is developed, a hybrid point-touch input technique that allows users to seamlessly reach distant objects on tabletop displays.
Advances in human factors/ergonomicsEye-gaze control of multimedia systems
53 Citations1995John Paulin Hansen, Allan W. Andersen +1 more
It is suggested that interest and emotion sensitive media hold great potential for information systems in general—for example, information stands and interactive television.
Multimodal speech-gesture interface for handfree painting on a virtual paper using partial recurrent neural networks as gesture recognizer
46 Citations2003Andrea Corradini, Philip R. Cohen
A simple magnetic field tracker-based pointing system as input device for a painting system to provide a convenient means for the user to specify paint locations on any virtual paper.
Pointing in Intelligent Environments with the WorldCursor.
40 Citations2003Andrew D. Wilson, Hubert Pham
The WorldCursor improves upon the XWand by removing the need for external positioning technology such as video cameras, and discusses its application in intelligent environments.
Useful parameters for the design of laser pointer interaction techniques
21 Citations2001Choon Hong Peck
Fundamental parameters like the size of the dwell of a laser point, the time taken to acquire a target and the time required to determine a dwell on a target are reported on.
The optical tweezers
19 Citations2003Sergey V. Matveyev, Martin Göbel
The proposed multiple-point interaction technique realizes direct interaction and control in a virtual environment and presentation by constructing a device on the basis of the infrared (IR) laser which is invisible for a human eye.
Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft)Laser Pointer Interaction with Hand Tremor Elimination
6 Citations2003Sergey V. Matveyev, Goebel, M. +1 more
The proposed pointing technique realizes a direct control in a graphical presentation environment at a distance with hand tremor elimination with smoothing of the data received from the camera, allows to fix the cursor even on the small objects as for it reduces the effect of the cursor trembling on the screen.
Auramirror
4 Citations2004Alexander W. Skaburskis, Roel Vertegaal +1 more
An interactive art piece that raises questions of how computers use the authors' attention by measuring attention and visualizing the results for the audience in real-time, Auramirror brings the subject matter to the forefront of the audience's consideration.