Evaluation of Multi-party Virtual Reality Dialogue Interaction
Published 1 May 2004
David Traum, Susan Robinson, Jens Stephan
Citations37
SJR quartileQ1
SJR score0.48
SNIP1.79
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A dialogue evaluation plan for a multi-character virtual reality training simulation, including user satisfaction, intended task completion, recognition rate, and a new annotation scheme for appropriateness is described.
Abstract
We describe a dialogue evaluation plan for a multi-character virtual reality training simulation. A multi-component evaluation plan is presented, including user satisfaction, intended task completion, recognition rate, and a new annotation scheme for appropriateness. Preliminary results for formative tests are also presented.
Keywords
PsychologyComputer ScienceEngineering
PARADISE
538 Citations1997Marilyn Walker, Diane Litman +2 more
This paper presents PARADISE (PARAdigm for DIalogue System Evaluation), a general framework for evaluating spoken dialogue agents that decouples task requirements from an agent's dialogue behaviors, supports comparisons among dialogue strategies, and makes it possible to compare agents performing different tasks by normalizing for task complexity.
ArXiv.orgMetrics for Evaluating Dialogue Strategies in a Spoken Language System
155 Citations1996Morena Danieli, Elisabetta Gerbino
A new metric is defined, the implicit recovery, which allows to measure the ability of a dialogue manager to deal with errors by different levels of analysis and is compared to two different approaches to dialogue repair strategies.
Oxford University Press eBooksSpoken Natural Language Dialog Systems
117 Citations1995Ronnie W. Smith, D. Richard Hipp
In discharging exhaust room air through a heat exchange Coil, outside air is introduced into a case housing the heat exchange coil and the exhaust roomAir and outside air are mixed together within the case to make up for the shortage of thehaust room air to be passed through the heat Exchange coil for heat exchange.
University Libraries (University of Maryland)Coding Discourse Structure in Dialogue (Version 1.0)
24 Citations1999Christine H. Nakatani, David Traum
Lecture notes in computer scienceA task-based evaluation of the TRAINS-95 dialogue system
22 Citations1997Teresa Sikorski, James F. Allen
A task-based evaluation methodology appropriate for dialogue systems such as the TRAINS-95 system, where a human and a computer interact and collaborate to solve a given problem.
Munich Personal RePEc Archive (Ludwig Maximilian University of Munich)Simulation Meets Hollywood: Integrating Graphics, Sound, Story and Character for Immersive Simulation
12 Citations2005William Swartout, Jonathan Gratch +6 more
The Mission Rehearsal Exercise system and the insights gained through this large-scale integration are described, which confronts a soldier trainee with the kinds of dilemmas he might reasonably encounter in a peacekeeping operation.