Transforming Graphical Interfaces Into Auditory Interfaces for Blind Users
Human-Computer InteractionPublished 1 March 1997
Elizabeth D. Mynatt
Citations74
SJR quartileQ1
SJR score1.03
SNIP1.76
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
In this design, the salient components of graphical interfaces are transformed into auditory interfaces, which results in a usable interface that meets the needs of blind users while providing many of the benefits of graphical interfaces.
Abstract
While graphical interfaces have provided a host of advantages to the majority of computer users, they have created a significant barrier to blind computer users. To meet the needs of these users, a methodology for transforming graphical interfaces into nonvisual interfaces has been developed. In this design, the salient components of graphical interfaces are transformed into auditory interfaces. Based on a hierarchical model of the graphical interface, the auditory interface utilizes auditory icons to convey interface objects. Users navigate the interface by traversing its hierarchical structure. This design results in a usable interface that meets the needs of blind users while providing many of the benefits of graphical interfaces. 2 1. INTRODUCTION 2. BACKGROUND 2.1. The GUI Problem 2.2. Requirements for GUI Access by Blind Users 2.3. Evaluation of Screen Reader Interfaces 3. MODELING GRAPHICAL INTERFACES 3.1. Determining the Contents of the Interface Transformation What are...
Keywords
Computer ScienceNeuroscience
The American Journal of PsychologyThe Psychology of Everyday Things
3,480 Citations1990Dominic W. Massaro, Donald A. Norman
Human-Computer InteractionDirect Manipulation Interfaces
1,297 Citations1985Edwin Hutchins, James D. Hollan +1 more
A cognitive account of both the advantages and disadvantages of direct manipulation interfaces is sought and two underlying phenomena that give rise to the feeling of directness of manipulation are identified.
Human-Computer InteractionEarcons and Icons: Their Structure and Common Design Principles
975 Citations1989Meera Blattner, D A Sumikawa +1 more
Earcons are audio messages used in the user-computer interface to provide information and feedback to the user about computer entities, and design principles that are common to both visual symbols anditory messages are identified.
Designing SpeechActs
248 Citations1995Nicole Yankelovich, Gina‐Anne Levow +1 more
An experimental conversational speech system and a set of challenging issues facing speech interface designers are examined and approaches to address some of these challenges are described.
Nonvisual presentation of graphical user interfaces
155 Citations1994Elizabeth D. Mynatt, Gerhard Weber
This paper discusses four main interface design issues for access systems, and describes how the Mercator and GUIB designs have addressed these issues, hoping that the exploration of these interfaces will lead to better nonvisual interfaces used in low visibility and visually overloaded environments.
Communications of the ACMComputers and people with disabilities
115 Citations1992Ephraim P. Glinert, Bryant W. York
Everyday listening and auditory icons
105 Citations1988William Gaver, Donald A. Norman
The basic idea is that auditory icons, caricatures of everyday sounds, may be used to present information to users in a way that is analogous to the use of visual icons.
VoiceNotes
99 Citations1993Lisa Stifelman, Barry Arons +2 more
VoiceNotes explores the problem of capturing and retrieving spontaneous ideas, the use of speech as data, and theUse of speech input and output in the user interface for a hand-held computer without a visual display.
International Journal of Man-Machine StudiesMultidimensional audio window management
86 Citations1991Michael Cohen, L. F. Ludwig
The result is a new user interface integrating and enhanced spatial sound presentation system, an audio emphasis system, and a gestural input recognition system that convey added information without distraction or loss of intelligibility.
Journal of Visual Impairment & BlindnessThe Graphical User Interface: Crisis, Danger, and Opportunity
85 Citations1990Lawrence H. Boyd, Wynn Leo Boyd +1 more
Designing with auditory icons
83 Citations1994Elizabeth D. Mynatt
In the first of a series of experiments, subjects were asked to describe a collection of short everyday sounds and the content and accuracy of their identifications offers guidelines for the use of auditory cues.
ComputerExtending the notion of a window system to audio
65 Citations1990L. F. Ludwig, N. Pincever +1 more
Preliminary work suggests that an effective audio window system needs much less complexity and fewer levels of digital signal processing precision than the current prototype.
An architecture for transforming graphical interfaces
34 Citations1994W. Keith Edwards, Elizabeth D. Mynatt
An architecture capable of transforming the graphical interfaces of existing applications into powerful intuitive nonvisual interfaces, called Mercator, which uses several novel techniques to efficiently and flexibly map graphical interfaces into new modalities.
Phoneshell
31 Citations1993Chris Schmandt
Phoneshell offers its users numerous opportunities to record voice entries into its underlying databases; this new utility for stored voice as a data type, necessitates multimedia support for the traditional graphical user interfaces to these same databases.
Talking vs taking
23 Citations1994Nicole Yankelovich
Telephoning your computer rather than taking it along makes more sense, since you call the same computer you work with all the time, there is no need to transfer information, and you have access to your usual networked environment complete with any shared applications and data updated by others.
International Journal of Man-Machine StudiesModelling blind users' interactions with an auditory computer interface
23 Citations1989Alistair D. N. Edwards
This paper describes the development of a model of users' interaction with an auditory interface based on the approach applied by Card, Moran & Newell (1980; 1983) to modelling visual interfaces, and represents a first step towards expanding models of human-computer interactions to include auditory interactions.
Transforming graphical interfaces into auditory interfaces
20 Citations1995Elizabeth D. Mynatt
This work explores transforming graphical interfaces into auditory interfaces by transparently transforming graphical application written with a commercial toolkit, and helps build a robust system that supports access to numerous applications and levels of user expertise.
Design and Evaluation of an Auditory Glance at Algebra for Blind Readers
18 Citations1994Robert Stevens, Stephen Brewster +2 more
The sonification of algebra notation is described to provide an audio glance to facilitate planning prior to reading to recover syntactic information the listeners could retain and recall, and also the strategies used.
Communicating and Learning Through Non-speech Audio
13 Citations1992Meera Blattner, Robert M. Greenberg
This chapter is based upon a good example of the expansion of the interface in that previously auditory output from computers have generally been restricted to undifferentiated ‘beeps’, which implies that one of the most powerful channels of communication has been virtually ignored.
DSpace@MIT (Massachusetts Institute of Technology)Chatter--a conversational telephone agent
6 Citations1993Eric Thich Vi Ly
Thesis (M.S.)--Massachusetts Institute of Technology, Program in Media Arts & Sciences, 1993.
A Remote Access Protocol for the X Window System
3 Citations1995W. Keith Edwards, Susan H. Liebeskind +2 more
This paper presents a protocol which communicates information about graphical interfaces between X applications, called Remote Access Protocol (RAP), which can be used to script or test graphical applications, or translate a graphical application to a non-visual presentation.
The NA3 Audio Server
2 Citations1994David A. Burgess
Runtime translation of X interfaces to support visually-impaired users
2 Citations1993W. Keith Edwards, Tom Rodriguez
This paper describes work to provide mappings between X-based graphical user interfaces and auditory interfaces transparently to applications to provide accessibility to graphical applications for users who are blind.