Nature and origins of virtual environments: a bibliographical essay
Computing Systems in EngineeringPublished 1 January 1991
Stephen R. Ellis
Citations158
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
Virtual environments presented via head-mounted, computer-driven displays provide a new media for communication. They may be analyzed by considering: (1) what may be meant by an environment; (2) what is meant by the process of virtualization; and (3) some aspects of human performance that constrain environmental design. Their origins are traced from previous work in vehicle simulation and multimedia research. Pointers are provided to key technical references, in the dispersed, archival literature, that are relevant to the development and evaluation of virtual-environment interface systems.
Keywords
Computer ScienceEngineering
American Journal of Physics<i>The Fractal Geometry of Nature</i>
21,750 Citations1983Benoît B. Mandelbrot, John Wheeler
General Pharmacology The Vascular SystemThe visual display of quantitative information
5,120 Citations1985
Contributions to the theory of optimal control
1,697 Citations1960R. E. Kalman
Semiology of Graphics: Diagrams, Networks, Maps
1,573 Citations2010Jacques Bertin, William J. Berg
This work is an unprecedented attempt to synthesize principles of graphic communication with the logic of standard rules applied to writing and topography in an array of more than 1,000 maps and diagrams.
The Visual ComputerThe plane with parallel coordinates
1,411 Citations1985Alfred Inselberg
A new duality betweenbounded and unbounded convex sets and hstars (a generalization of hyperbolas) and between Convex Unions and Intersections is found and motivates some efficient ConveXity algorithms and other results inComputational Geometry.
CERN Document Server (European Organization for Nuclear Research)Introduction to simulation and SLAM II
1,238 Citations1979A. Alan B. Pritsker
This volume discusses simulation techniques and procedures, simulation approaches to problem resolution, applications of simulation, and more, using SLAM, an advanced FORTRAN language for simulation models.
IEEE Transactions on Robotics and AutomationA design framework for teleoperators with kinesthetic feedback
913 Citations1989Blake Hannaford
It is shown that the hybrid model (as opposed to other two-port forms) leads to an intuitive representation of ideal teleoperator performance and applies to several teleoperator architectures.
Elements of Cartography
844 Citations1953Arthur H. Robinson
Philosophical transactions of the Royal Society of London. Series B, Biological sciencesPerceptions as hypotheses
781 Citations1980Richard Langton Gregory
Experimental results are presented, aimed at distinguishing between and disconvering what happens when there is mismatch with the neural signal channel, and when neural signals are processed inappropriately for the current situation.
The Ultimate Display
754 Citations1965Ivan E. Sutherland
The authors live in a physical world whose properties they have come to know well through long familiarity but lack corresponding familiarity with the forces on charged particles, forces in non-uniform fields, the effects of nonprojective geometric transformations, and high-inertia, low friction motion.
PubMedEye movements and their role in visual and cognitive processes.
699 Citations1990Eileen Kowler
The role of visual and cognitive processes in the control of eye movement and the role of eye movements in the detection of contrast and spatial detail is examined.
The Journal of the Acoustical Society of AmericaHeadphone simulation of free-field listening. I: Stimulus synthesis
670 Citations1989Frederic L. Wightman, Doris J. Kistler
Techniques used to synthesize headphone-presented stimuli that simulate the ear-canal waveforms produced by free-field sources are described, showing that the simulations duplicate free- field waveforms within a few dB of magnitude and a few degrees of phase at frequencies up to 14 kHz.
The Journal of the Acoustical Society of AmericaHeadphone simulation of free-field listening. II: Psychophysical validation
616 Citations1989Frederic L. Wightman, Doris J. Kistler
Listeners reported the apparent spatial positions of wideband noise bursts that were presented either by loudspeakers in free field or by headphones, with the aim of duplicating, at a listener's eardrums, the waveforms that were produced by the free-field stimuli.
The International Journal of Robotics ResearchThe UTAH/M.I.T. Dextrous Hand: Work in Progress
615 Citations1984S.C. Jacobsen, John Wood +2 more
The paper reviews progress to date on project subtasks and discusses design issues important to hardware and control systems develop in a tendon-oper ated multiple-degree-of-freedom dextrous hand with multichannel touch-sensing capability.
IEEE Transactions on Aerospace and Electronic SystemsMagnetic Position and Orientation Tracking System
604 Citations1979Frederick H. Raab, Ernest Blood +2 more
Artificial reality II
594 Citations1991Myron W. Krueger
This artificial reality ii to read, where one to remember is not only the PDF, but also the genre of the book, will influence how you read the book finished or not.
Computer Graphics and Image ProcessingOct-trees and their use in representing three-dimensional objects
577 Citations1980Chris L. Jackins, Steven L. Tanimoto
Oct-Trees are developed as a three-dimensional analog of quad-trees to be used in geometric modeling and space planning and a fast algorithm is given for 90° rotation of oct-tree representations of objects.
AutomaticaAn optimal control model of human response part I: Theory and validation
499 Citations1970David L. Kleinman, Sheldon Baron +1 more
The model is described in detail and is used to predict experimentally measured quantities for three simple, but basic, compensatory tracking tasks and is applied to study a complex VTOL hovering task.
Computers in PhysicsThe Media Lab: Inventing the Future at M.I.T.
492 Citations1988Stewart Brand, Richard E. Crandall
Brand explores the exciting programs, and gives readers a look at the future of communications, being developed at MIT's Media Lab.
Mathematical BiosciencesOptimization of muscle-force sequencing in human locomotion
398 Citations1978A. Pedotti, V. V. Krishnan +1 more
Experimental kinematic and ground reaction measurements along with EMG data from the same subjects obtained during level walking enables us to select J=∑( F i F max ) 2 as the most feasible criterion.
ACM SIGCHI BulletinA hand gesture interface device
391 Citations1986Thomas G. Zimmerman, Jaron Lanier +3 more
Towards image realism with interactive update rates in complex virtual building environments
350 Citations1990John Airey, John H. Rohlf +1 more
Two strategies, pre-computation before display and adaptive refinement during display, are used to combine interactivity with high image quality in a virtual building simulation.
Virtual environment display system
281 Citations1987Scott S. Fisher, Michael W. McGreevy +2 more
A head-mounted, wide-angle, stereoscopic display system controlled by operator position, voice and gesture has been developed for use as a multipurpose interface environment and primary applications are in telerobotics, management of large-scale integrated information systems, and human factors research.
The phantom robot: predictive displays for teleoperation with time delay
271 Citations2002A.K. Bejczy, W.S. Kim +1 more
Predictive display enhanced the human operator's telemanipulation task performance significantly during free motion when there is a long time delay, it appears, however, that either two-view or stereoscopic predictive displays are necessary for general three-dimensional tasks.
Environment and BehaviorThe Placement and Misplacement of You-Are-Here Maps
246 Citations1984Marvin Levinew, Iris Marchon +1 more
A theory of spatial problem solving led to the prediction that the ease of use of you-are-here maps would depend upon where they were placed in relation to the terrain, and two experiments confirmed the prediction.
Movie-maps
239 Citations1980Andrew Lippman
An interactive, dynamic map has been built using videodisc technology to engage the user in a simulated “drive” through an unfamiliar space, and to incorporate optical and electronic image processing to provide a more responsive, visually complete representation of an environment.
ACM SIGCHI BulletinVIDEOPLACE—an artificial reality
238 Citations1985Myron W. Krueger, Thomas Gionfriddo +1 more
Proceedings of the Royal Society of London. Series B, Biological sciencesPerceptual illusions and brain models
228 Citations1968Richard Langton Gregory
Grasping reality through illusion---interactive graphics serving science
228 Citations1988Frederick P. Brooks
A shells-of-certainty model for knowledge of virtual-worlds research, the construction of real-time 3-D illusions by computer graphics, and some observations about interfaces to virtual worlds are proposed.
The star user interface
225 Citations1982David Canfield Smith, Charles Irby +2 more
The Star user interface differs from that of other office computer systems by its emphasis on graphics, its adherence to a metaphor of a physical office, and its rigorous application of a small set of design principles.
Worlds within worlds: metaphors for exploring n-dimensional virtual worlds
217 Citations1990Steven Feiner, Clifford Beshers
This work describes an example n-Vision application in “financial visualization,” where the functions are models of financial instruments, and introduces a new interaction metaphor developed for the system, which is called “worlds within worlds”: nested heterogeneous coordinate systems that allow the user to view and manipulate functions.
Vision ResearchEye movements and stereopsis during dichoptic viewing of moving random-dot stereograms
208 Citations1985Casper J. Erkelens, H. Collewijn
The presence of sinusoidally varying overall binocular disparities and ocular vergence movements without perception of motion in depth suggests that these variables are not adequate cues for perception of (change in) depth.
Vision ResearchMotion perception during dichoptic viewing of moving random-dot stereograms
195 Citations1985Casper J. Erkelens, H. Collewijn
It is concluded that a visual frame of reference is essential for perception of motion in depth but not for Perception of lateral movements, and it seems likely that not absolute binocular disparity but relative Binocular disparity (differences in angular distance between two or more corresponding features in the two retinal images) is a cue for perception in depth.
Experimental Brain ResearchAdaptive modification of the vestibulo-ocular reflex by mental effort in darkness
193 Citations1984G. Melvill Jones, Alain Berthoz +1 more
The vestibulo-ocular reflex can be suppressed in darkness if a subject tries to imagine that he looks at a head fixed target, and this mental suppression of VOR was used to induce adaptive changes in VOR gam during 3 h of active head oscillations in complete darkness.
Energy constraints on parameterized models
188 Citations1987Andrew Witkin, Kurt Fleischer +1 more
A simple but general approach to imposing and solving geometric constraints on parameterized models is introduced, applicable to animation as well as model construction.
Journal of Experimental PsychologyAdaptation to displaced and delayed visual feedback from the hand.
174 Citations1966Richard Held, Aglaia Efstathiou +1 more
Responsive environments
158 Citations1977Myron W. Krueger
The concept of a responsive environment which perceives human behavior and responds with intelligent auditory and visual feedback is introduced and a new art form of composed man-machine interaction is defined.
IEEE Transactions on Man Machine SystemsTheory of Manual Vehicular Control
156 Citations1969Duane T. McRuer, D H Weir
The analytical basis of manual vehicular control theory is a combination of feedback systems analysis and mathematical models for human operators engaged in control tasks, and simplified representations for the operator-system combination are provided by the 'crossover model', which is described in detail.
The Geometry Engine
153 Citations1982James H. Clark
This paper describes the Geometry Engine and the Geometric Graphics System it composes, and presents the instruction set of the system, its design motivations and theGeometry System architecture.
Interactive dynamics
151 Citations1990Andrew Witkin, Michael Gleicher +1 more
This work presents a mathematical and computational formulation for constrained dynamics that makes the ability to create complex physical models dynamically by snapping simple pieces together, integrating the process of model creation into the ongoing simulation.
Human Factors The Journal of the Human Factors and Ergonomics SocietyThe Effect of Perspective Geometry on Judged Direction in Spatial Information Instruments
144 Citations1986Michael W. McGreevy, Stephen R. Ellis
A geometrical model of an interpretive behavior associated with viewing perspective displays in which the sinusoidal pattern of azimuth errors is induced by the difference between the 3D stimulus and its 2D projection, and by the consequences of the geometric differences between the station point and the observer's actual eye position is proposed.
Human Factors The Journal of the Human Factors and Ergonomics SocietyPerspective Traffic Display Format and Airline Pilot Traffic Avoidance
141 Citations1987Stephen R. Ellis, Michael W. McGreevy +1 more
IRE Transactions on Automatic ControlAn adaptive artificial hand
137 Citations1962R. Tomović, Giuseppe Boni
The most importemt feature of the new hand is the two level control, which can be controlled by signals produced by man as well as by external stimuli.
ScienceSensors, Controls, and Man-Machine Interface for Advanced Teleoperation
132 Citations1980Antal K. Bejczy
The state of the art is summarized, a brief outline of the basic problems is given, and the results of teleoperator research and development at the Jet Propulsion Laboratory are presented.
ScienceVisually Guided Locomotion: Psychophysical Evidence for a Neural Mechanism Sensitive to Flow Patterns
117 Citations1979D. Regan, K. I. Beverley
Inspecting a radial flow pattern depressed visual sensitivity to changes in the size of a small test square, but only when the square was located near the focus of the flow pattern, suggesting that precise visual judgments of one's direction of forward motion with respect to the outside world may be mediated by an already known neural organization sensitive to changes of small objects.
ACM SIGGRAPH Computer GraphicsEnergy constraints on parameterized models
117 Citations1987Andrew Witkin, Kurt Fleischer +1 more
Experimental Brain ResearchM.I.T./Canadian vestibular experiments on the Spacelab-1 mission: 4. Space motion sickness: symptoms, stimuli, and predictability
112 Citations1986Charles M. Oman, Byron K. Lichtenberg +2 more
Results support the view that space sickness is a motion sickness, and all subjects were asymptomatic making head movements in parabolic flight 4 days after the mission, but not 1 year later.
Communications of the ACMOn the design of display processors
109 Citations1968T. H. Myer, Ivan E. Sutherland
The flexibility and power needed in the channel for a computer display are considered and it is found that successive improvements to the display processor design lie on a circular path, by making improvements one can return to the original simple design plus one new general purpose computer for each trip around.
IEEE Computer Graphics and ApplicationsA kinematic model of the human spine and torso
103 Citations1991Gary D. Monheit, Norman I. Badler
The model of spinal motion, which is represented within Jack (a software system for human figure modeling and manipulation), is described and the impact parameters, vertebral joint movement, and the spine database are considered.
Interactive real-time articulated figure manipulation using multiple kinematic constraints
100 Citations1990Cary B. Phillips, Jianmin Zhao +1 more
An adaptive technique is used for evaluating the constraints which allows the user to ensure that only a certain user-controllable amount of time will be consumed by the inverse kinematics algorithm at each iteration of the manipulation process.
ACM SIGGRAPH Computer GraphicsThe Geometry Engine
98 Citations1982James H. Clark
The Geometry Engine is a special-purpose VLSI processor for computer graphics for accomplishing three basic operations in computer graphi...
Human Factors The Journal of the Human Factors and Ergonomics SocietyThe Internal Model Concept: An Application to Modeling Human Control of Large Ships
96 Citations1977W. Veldhuyzen, H.G. Stassen
In this paper, the literature on manual control will be reviewed briefly with attention focused on the use of the internal model concept, and an application is given in the human control of large ships.
Proceedings of the Human Factors Society Annual MeetingA Virtual Display System for Conveying Three-Dimensional Acoustic Information
94 Citations1988Elizabeth M. Wenzel, Frederic L. Wightman +1 more
Although the realtime device is not yet complete, recent studies at the University of Wisconsin have confirmed the perceptual adequacy of the basic approach to synthesis, the NASA-Ames prototype maximizes flexibility and portability by synthetically generating three-dimensional sound in realtime for delivery through headphones.
ACM SIGGRAPH Computer GraphicsTowards image realism with interactive update rates in complex virtual building environments
85 Citations1990John Airey, John H. Rohlf +1 more
Neural ComputationVisual Perception of Three-Dimensional Motion
84 Citations1990David J. Heeger, Allan Jepson
This work has come to understand that this nonlinear equation describing the optical-flow field can be split by an exact algebraic manipulation to yield an equation that relates the image velocities to the translational component of the 3D motion alone.
Tele-existence (I): Design and Evaluation of a Visual Display with Sensation of Presence
84 Citations1985Susumu Tachi, K. Tanie +2 more
The experiment reveals that the metric of the binocular visual space viewed with the naked eye can be reserved in tele-existence system by servoing the focal length of the display lenses and the angle of the convergence of the two CRTs appropriately.
Force display performs better than visual display in a simple 6-D docking task
83 Citations2003O.-Y. Ming, David V. Beard +1 more
A pilot-controlled experiment showed force display to be more effective, and showed that the simple 6-D docking task can reliably be done with this visual display alone, and also showed that subjects are able to find the zero-force position more than twice as fast with a force display alone than with aVisual display alone.
NASA Technical Reports Server (NASA)Kinesthetic coupling between operator and remote manipulator
71 Citations1980A.K. Bejczy, J. Kenneth Salisbury
ACM SIGGRAPH Computer GraphicsInteractive dynamics
64 Citations1990Andrew Witkin, Michael Gleicher +1 more
Journal of Experimental Psychology Human Perception & PerformanceBinocular distance perception: Egocentric distance tasks.
64 Citations1985John Miles Foley
A theory of binocular distance perception that has been shown to give a good account of performance in relative distance tasks is extended and tested in two experiments in which the observer directly indicates perceived egocentric distance of targets by means of a verbal report or manual pointing response.
Virtual RealityVirtual Reality and Planetary Exploration
60 Citations1993Michael W. McGreevy
Virtual reality technology has the potential to democratize the experience of planetary exploration, which could have a profound effect on public perceptions of the U.S. space program.
Optical EngineeringPerformance and head movements using a helmet-mounted display with different sized fields-of-view
59 Citations1990Maxwell J. Wells
It appeared that performance at the task was limited by how well subjects integrated information about target locations and not by how fast or how much they could move their heads, and that head velocity was mediated by the certainty with which subjects remembered target locations.
24Sensory conflict in motion sickness: an Observer Theory approach
55 Citations1991Charles M. Oman
The stimuli which causes sickness, synthesizes a contemporary Observer Theory view of the Sensory Conflict hypothesis are reviewed, and a revised model for the dynamic coupling between the putative conflict signals and nausea magnitude estimates is presented.
ACM SIGGRAPH Computer GraphicsInteractive real-time articulated figure manipulation using multiple kinematic constraints
50 Citations1990Cary B. Phillips, Jianmin Zhao +1 more
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIEImplementation and integration of a counterbalanced CRT-based stereoscopic display for interactive viewpoint control in virtual-environment applications
45 Citations1990Ian E. McDowall, Mark Bolas +3 more
The CCSV approach is particularly well suited to applications in which 1) the user moves back and forth between virtual environment viewing and desk work, 2) high resolution views of the virtual environment are required or 3) the viewing device is to be shared among collaborators in a group setting.
IEEE Transactions on Systems Man and CyberneticsThe Emergence of Zipf's Law: Spontaneous Encoding Optimization by Users of a Command Language
41 Citations1986Stephen R. Ellis, Robert J. Hitchcock
The distribution of commands issued by experienced users of a computer operating system allowing command customization tends to conform to Zipf's law, documents the emergence of a statistical property of natural language as users master an artificial language.
The Journal of the Acoustical Society of AmericaAcoustic origins of individual differences in sound localization behavior
40 Citations1988Elizabeth Wenzel, Frederic L. Wightman +2 more
A real-time optical 3D tracker for head-mounted display systems
39 Citations1990Jih‐Fang Wang, Vernon Chi +1 more
An iterative algorithm is designed to estimate the 3D position of the camera assembly in space, a generalized version of the Church's method, and allows for multiple cameras with nonconvergent nodal points.
IEEE Transactions on Robotics and AutomationOperational analysis of an autonomous assembly robotic station
34 Citations1989Abraham Seidmann, Shimon Y. Nof
The authors present operational analysis models of autonomous assembly robotic stations that provide a cost-effective solution for the assembly of small batch sizes and a model of industrial controlled rework is developed for stations with a bounded number network attempts and distinct rework rates at each trial.
Intelligent User InterfacesAn introduction to HITS: Human Interface Tool Suite
31 Citations1991James D. Hollan, Elaine Rich +5 more
The Human Interface Tool Suite is introduced, an integrated set of tools for the construction of collaborative multimedia interfaces to high-functionality systems and the ideas that motivate the HITS research programme are explained.
Applied OpticsThree-dimensional optometer
25 Citations1988Tsunehiro Takeda, Yukio Fukui +1 more
The optical and control principles of a newly developed three-dimensional optometer (TDO) that makes it possible to measure simultaneously three basic ocular responses in an actual work situation: accommodation; eye movement; and pupil area is described.
Journal of the Robotics Society of JapanAn image-directed robotic system for hip replacemetn surgery.
19 Citations1990Russell H. Taylor, Howard A. Paul +8 more
An image-directed robotic system to augment the performance of human surgeons in precise bone machining procedures in orthopaedic surgery, initially targeted at cementless total hip replacement surgery has demonstrated an order-of-magnitude improvement in implant fit and placement accuracy, compared to standard manual preparation techniques.
On-the-screen visual enhancements for a telerobotic vision system
17 Citations2005W.S. Kim, Munehisa Takeda +1 more
Experimental results indicate that on-the-screen visual enhancements such as a vertical reference line, a stick figure model of the manipulator gripper and its projection, and a reference grid greatly improves the human performance of telemanipulation tasks, especially when objects to pick up lie on the robot base plane.
DAIMI Report SeriesLanguage Evolution and Human-Computer Interaction
17 Citations1991Jonathan Grudin, Donald A. Norman
By discerning where the pressures that guide natural language evolution also appear in humancomputer interaction, the author can contribute to the design of computer systems and obtain a new perspective on natural languages.
Interactive Orbital Proximity Operations Planning System
16 Citations2005Arthur J. Grunwald, Stephen R. Ellis
An interactive graphical proximity operations planning system has been developed, which allows on-site design of efficient complex multi-burn maneuvers in the dynamic multi-spacecraft environment about the space-station.
Proceedings of the Human Factors Society Annual MeetingSymbolic Enhancement of Perspective Displays
14 Citations1990Stephen R. Ellis, Selim S. Hacısalihzade
Applied ErgonomicsHuman machine interfaces for tele-operators and virtual environments
13 Citations1992N. I. Durlach, Thomas B. Sheridan +1 more
This is a collection of conference-related fragments that will give a glimpse of the potential of the following fields and how they interplay: sensorimotor performance; human-machine interfaces; teleoperation; virtual environments; performance measurement and evaluation methods; and design principles and predictive models.
From DataGlove to DataSuit
12 Citations1988Ann Lasko-Harvill, Chuck Blanchard +3 more
Sensors on the DataSuit, a garment covering the body from neck to ankles, register the position and orientation of the joints of the body to track the movement of the individual in six degrees of freedom within the room.
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE<title>Virtual environment for the exploration of three-dimensional steady flows</title>
10 Citations1991Steve Bryson, Creon Levit
A recently completed implementation of a virtual environment for the analysis of three- dimensional steady flowfields, which are velocity vector fields defined on curvilinear meshes, and are the steady-state solutions to problems in computational fluid dynamics.
NASA Technical Reports Server (NASA)Simulation of an advanced scout attack helicopter for crew station studies
10 Citations1987P. LYPACZEWSKI, A. D. Jones +1 more
The system complexity and high workload of the next generation of light scout/attack helicopters is being evaluated in the Crew Station Research and Development Program and the crew station experiments are described along with the facility elements and simulation.
Elsevier eBooksFIXATION SUPPRESSION OF THE VESTIBULAR OCULAR REFLEX AND HEAD MOVEMENT CORRELATED EEG POTENTIALS
9 Citations1987Wolfgang H. Zangemeister, Hans-Christian Hansen
Recording in healthy volunteers of fast voluntary horizontal head movements demonstrated that strong stimulation of joint vestibular and somatosensory (neck afferent) input facilitated characteristically related EEG activity.
NASA Technical Reports Server (NASA)The dynamics of orbital maneuvering: Design and evaluation of a visual display aid for human controllers
9 Citations1990Stephen R. Ellis, Arthur J. Grunwald
NASA STI Repository (National Aeronautics and Space Administration)The making of The Mechanical Universe
7 Citations1989J.F. Blinn
The Mechanical Universe project required the production of over 550 different animated scenes, totaling about 7 and 1/2 hours of screen time, and required the use of a wide range of techniques.
NASA Technical Reports Server (NASA)A high performance two degree-of-freedom kinesthetic interface
6 Citations1991Bernard D. Adelstein, Michael J. Rosen
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE<title>Human visual performance model for crewstation design</title>
4 Citations1991James Larimer, Michael P. Prevost +4 more
The Visibility Modeling Tool (VMT) provides the designer with a CAD tool for assessing the trade-offs that result from different designs and answers questions such as ''Will the pilot be able to read the display?''
Interactive orbital proximity operations planning system
2 Citations2005Arthur J. Grunwald, Stephen R. Ellis
…