UI on the Fly: Generating a Multimodal User Interface
38 Citations•2004•
D. Reitter, Erin Panttaja, Fred Cummins
Proceedings of HLT-NAACL 2004: Short Papers on XX - HLT-NAACL '04
UI on the Fly is a system that dynamically presents coordinated multimodal content through natural language and a small-screen graphical user interface that adapts to the user's preferences and situation.
Abstract
UI on the Fly is a system that dynamically presents coordinated multimodal content through natural language and a small-screen graphical user interface. It adapts to the user's preferences and situation. Multimodal Functional Unification Grammar (MUG) is a unification-based formalism that uses rules to generate content that is coordinated across several communication modes. Faithful variants are scored with a heuristic function.