Should I Stay or Should I Go? Selecting Between Touch and Mid-Air Gestures for Large-Display Interaction
Lecture notes in computer sciencePublished 1 January 2015
Mikkel R. Jakobsen, Yvonne Jansen, Sebastian Boring, Kasper Hornbæk
Citations38
SJR quartileQ2
SJR score0.35
SNIP0.55
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This work compares touch and mid-air gestures to identify their relative performance for target acquisition and shows that when faced with an increasing cost of using touch in the form of movement, participants chose mid-Air over touch; touch remains as fast as mid- air on average.
Abstract
International audience
Keywords
Computer ScienceNeuroscience
Choice Reviews OnlineThe Human-computer interaction handbook: fundamentals, evolving technologies, and emerging applications
1,359 Citations2013Juliele A. Jacko
This book discusses the evolution of Human-Computer Interaction in the age of Experience Ecosystems, as well as design principles for Usable Interfaces and Privacy, Security, and Trust.
Interactive public ambient displays
648 Citations2004Daniel Vogel, Ravin Balakrishnan
Design principles and an interaction framework for sharable, interactive public ambient displays that support the transition from implicit to explicit interaction with both public and personal information are developed.
The bubble cursor
589 Citations2005Tovi Grossman, Ravin Balakrishnan
Results show that the bubble cursor significantly outperforms the point cursor and the object pointing technique, and that bubble cursor performance can be accurately modeled and predicted using Fitts' law.
Shift
465 Citations2007Daniel Vogel, Patrick Baudisch
The results of a user study are reported showing that with Shift participants can select small targets with much lower error rates than an unaided touch screen and that Shift is faster than Offset Cursor for larger targets.
Communications of the ACMMeasuring usability
456 Citations1994Jakob Nielsen, Jonathan Levy
Measurable usability parameters fall into two broad categories: subjective user preference measures, assessing how much the users like the system, and objective performance measures, which measure how capable the users are at using the system.
Distant freehand pointing and clicking on very large, high resolution displays
422 Citations2005Daniel Vogel, Ravin Balakrishnan
Three techniques for gestural pointing and two for clicking are developed and evaluated and subtle auditory and visual feedback techniques are presented to compensate for the lack of kinesthetic feedback in freehand interaction.
Image plane interaction techniques in 3D immersive environments
417 Citations1997Jeffrey S. Pierce, Andrew Forsberg +4 more
This paper presents a set of interaction techniques for use in headtracked immersive virtual environments that can be used for object selection, object manipulation, and user navigation in virtual environments.
1 € filter
392 Citations2012Géry Casiez, Nicolas Roussel +1 more
The 1 € filter ("one Euro filter") is a simple algorithm to filter noisy signals for high precision and responsiveness using a first order low-pass filter with an adaptive cutoff frequency.
Small Group ResearchShould I Stay or Should I Go?
338 Citations2003Mahmut Bayazıt, Elizabeth A. Mannix
Testing pointing device performance and user assessment with the ISO 9241, Part 9 standard
284 Citations1999Sarah A. Douglas, Arthur E. Kirkpatrick +1 more
This paper evaluates the scientific validity and practicality of these dimensions for two pointing devices for laptop computers, a finger-controlled isometric joystick and atouchpad, and a discussion of problems in implementing the IS0 standard and recommendations for improvement.
Interacting at a distance
279 Citations2002Brad A. Myers, Rishi Bhatnagar +5 more
It is found that tapping directly on a wall-size SmartBoard was the fastest and most accurate method, followed by a new interaction technique that copies the area of interest from the big screen to a handheld.
Meta-analysis of correlations among usability measures
268 Citations2007Kasper Hornbæk, Effie Lai‐Chong Law
A meta-analysis of correlations among usability measures calculated from the raw data of 73 studies is presented, finding that measures of users' perceptions of phenomena are generally not correlated with objective measures of the phenomena.
Move to improve
266 Citations2007Robert Ball, Chris North +1 more
Increased physical navigation on larger displays correlates with reduced virtual navigation and improved user performance and design factors that afford and promote the use of physical navigation in the user interface are identified.
Laser pointer interaction
247 Citations2001Dan R. Olsen, Travis Nielsen
A technique using a laser pointer and a camera to accomplish interactions at a distance from a display surface for navigation and entry of numbers, times, dates, text, enumerations and lists of items is described.
Drag-and-pop and drag-and-pick : Techniques for accessing remote screen content on touch and pen-operated systems
241 Citations2003Patrick Baudisch
The results of a user study comparing drag-and-pop with traditional drag- and-drop on a 15' (4.50m) wide interactive display wall are reported, showing participants where able to file icons up to 3.7 times faster when using the drag-And-pop interface.
XWand
228 Citations2003Andrew D. Wilson, Steven A. Shafer
The hardware device, signal processing algorithms to recover position and orientation, gesture recognition techniques, a multimodal (wand and speech) computational architecture and a preliminary user study examining pointing performance under conditions of tracking availability and audio feedback are detailed.
Touch projector
221 Citations2010Sebastian Boring, Dominikus Baur +3 more
Touch Projector is presented, a system that enables users to interact with remote screens through a live video image on their mobile device, and is found that participants achieved highest performance with automatic zooming and temporary image freezing.
Mid-air pan-and-zoom on wall-sized displays
206 Citations2011Mathieu Nancel, Julie Wagner +3 more
Significant effects were obtained for all three factors: bimanual interaction, linear gestures and a high level of guidance resulted in significantly improved performance, and the interaction effects among some of the dimensions suggest possible combinations for more complex, real-world tasks.
Interactions in the air
203 Citations2009Otmar Hilliges, Shahram Izadi +4 more
The goal is to design a technique that closely resembles the ways the authors manipulate physical objects in the real-world; conceptually, allowing virtual objects to be 'picked up' off the tabletop surface in order to manipulate their three dimensional position or orientation.
Communications of the ACMQuestioning naturalism in 3D user interfaces
194 Citations2012Doug A. Bowman, Ryan P. McMahan +1 more
3D UIs are uniquely able to achieve superior interaction fidelity, and this naturalism can be a huge advantage in the rapidly changing environment.
Robust computer vision-based detection of pinching for one and two-handed gesture input
189 Citations2006Andrew D. Wilson
A computer vision technique to detect when the user brings their thumb and forefinger together (a pinch gesture) for close-range and relatively controlled viewing circumstances is presented.
Vulture
156 Citations2014Anders Markussen, Mikkel R. Jakobsen +1 more
Improvements to Vulture are discussed and some alternative designs for mid-air text entry are discussed, suggesting that visual feedback is important but also limits performance.
Lecture notes in computer scienceThe Continuous Interaction Space: Interaction Techniques Unifying Touch and Gesture on and above a Digital Surface
115 Citations2011Nicolai Marquardt, Ricardo Jota +2 more
This work believes that the underlying system should treat the space on and above the surface as a continuum, where a person can use touch, gestures, and tangibles anywhere in the space and naturally move between them.
interactionsInteraction design for large displays
111 Citations1997Kishore S. Swaminathan, Steve Sato
This paper uses the Prairie system, a demonstration prototype that works with a display size of almost 6 feet by 3 feet and a resolution of 2400 by 1200 pixels, to illustrate many of the design issues that arise when designing for a large display.
Average task times in usability tests
108 Citations2010Jeff Sauro, James R. Lewis
Monte Carlo simulations using data from 61 large-sample usability tasks showed that the sample median is a biased estimate of the population median.
High-precision pointing on large wall displays using small handheld devices
108 Citations2013Mathieu Nancel, Olivier Chapuis +4 more
This work investigates high-precision pointing techniques capable of acquiring targets as small as 4 millimeters on a 5.5 meters wide display while leaving up to 93 % of a typical tablet device's screen space available for task-specific widgets.
International Journal of Human-Computer StudiesAir pointing: Design and evaluation of spatial target acquisition with and without visual feedback
101 Citations2011Andy Cockburn, Philip Quinn +3 more
The design space for air pointing interactions is explored, and tangible results are presented in the form of a framework that helps designers understand input dimensions and resulting interaction qualities and provides a foundation for innovation and understanding of air pointing interaction.
INPUT TECHNOLOGIES AND TECHNIQUES
100 Citations2007Ken Hinckley
A multiple-device approach for supporting whiteboard based interaction and the effects of group size and table size on interactions with tabletop shared-display groupware are explored.
ACM Transactions on Computer-Human InteractionUp close and personal
99 Citations2014Mikkel R. Jakobsen, Kasper Hornbæk
The study suggests that multitouch wall displays can support different collaboration styles and fluid transitions in group work, and contrast earlier research that suggests difficulties in sharing and collaborating around wall displays.
IEEE Transactions on Visualization and Computer GraphicsPerception of Visual Variables on Tiled Wall-Sized Displays for Information Visualization Applications
93 Citations2012Anastasia Bezerianos, Petra Isenberg
An understanding of, and indicators predicting how, large variations in viewing distances and viewing angles affect the accurate perception of angles, areas, and lengths is contributing to design considerations on how to create effective visualizations for these spaces.
Tangible remote controllers for wall-size displays
88 Citations2012Yvonne Jansen, Pierre Dragicevic +1 more
This work explores the use of customizable tangible remote controllers for interacting with wall-size displays and explains how to build such controllers using off-the-shelf touch tablets and describes a sample application that supports multiple dynamic queries.
A remote control interface for large displays
87 Citations2004Azam Khan, George Fitzmaurice +3 more
The results suggest that the frisbee is preferred over walking back and forth to the local and remote spaces at a distance of 4.5 feet.
Gradual engagement
86 Citations2012Nicolai Marquardt, Till Ballendat +3 more
The gradual engagement design pattern is formulated that generalizes prior work in proxemic interactions and informs future system designs and shows how existing and novel interaction techniques for cross-device transfers can be integrated to flow across its various stages.
ARC-Pad
84 Citations2009David McCallum, Pourang Irani
ARC-Pad (Absolute+Relative Cursor pad), a novel technique for interacting with large displays using a mobile phone's touchscreen that combines ab-solute and relative cursor positioning, is introduced.
Human-Computer InteractionThere and Back Again: Cross-Display Object Movement in Multi-Display Environments
60 Citations2009Miguel A. Nacenta, Carl Gutwin +2 more
Pointable
58 Citations2011Amartya Banerjee, Jesse Burstyn +2 more
Pointable, an in-air, bimanual perspective-based interaction technique that augments touch input on a tabletop for distant content, allows users to manipulate out-of-reach targets, without loss of performance, while minimizing the need to lean, stand up, or involve collocated collaborators.
Proceedings of the Human Factors and Ergonomics Society Annual MeetingEvaluation of Mouse and Touch Input for a Tabletop Display Using Fitts' Reciprocal Tapping Task
56 Citations2009Farzan Sasangohar, I. Scott MacKenzie +1 more
It is argued that, overall, touch input is a preferred and efficient input technique for tabletop displays, but that more research is needed to improve touch selection of small targets.
An experimental comparison of touch interaction on vertical and horizontal surfaces
39 Citations2012Esben Warming Pedersen, Kasper Hornbæk
An experiment manipulates the orientation of multi-touch surfaces to study how 16 participants tap and drag and shows that orientation impacts both performance and error rates.
Extending touch
37 Citations2009Alexander Schick, Florian van de Camp +2 more
The system is based on 3D reconstruction, using standard RGB cameras only, and allows seamless switching between touch and pointing, even while interacting, and found that users preferred the system to a touch-only system, because they had more freedom during interaction and could solve the presented task significantly faster.
Is Moving Improving?
35 Citations2015Mikkel R. Jakobsen, Kasper Hornbæk
The results suggest that moving may not be improving performance, depending on the use of virtual navigation, and that physical movement does benefit performance.
MirrorTouch
33 Citations2014Jörg Müller, Gilles Bailly +2 more
It was found that clear affordances for touch were necessary when mid-air gestures were present and a call-to-action caused significantly more users to touch than a button, and small variations in the application did lead to considerable user increase.
Interacting at a distance
27 Citations2002Brad A. Myers, Rishi Bhatnagar +5 more
Direct, bodily or mobile interaction?
18 Citations2012Ekaterina Kurdyukova, Mohammad Obaid +1 more
This work compares three interaction techniques: direct, bodily, and mobile-based, and analyzes how user preferences in the personalized display scenario are similar or different to other scenarios, such as interaction with physical objects or non-personalized public displays.
A closer look at note taking in the co-located collaborative visual analytics process
17 Citations2010Narges Mahyar, Ali Sarvghad +1 more
This paper highlights the important role that record-keeping (i.e. taking notes and saving charts) plays in collaborative data analysis within the business domain and suggests suggestions for the design of collaborative visual analytics tools.
Proceedings of the Human Factors and Ergonomics Society Annual MeetingEvaluation of Mouse and Touch Input for a Tabletop Display Using Fitts' Reciprocal Tapping Task
3 Citations2009Farzan Sasangohar, I. Scott MacKenzie +1 more
XWand
2 Citations2003Andrew D. Wilson, Steven A. Shafer