language: en

[Chapter 1]

MIAMM ? A MULTIMODAL DIALOGUE SYSTEM USING HAPTICS

Norbert Reithinger, Dirk Fedeler
DFKI ? German Research Center for Artificial Intelligence
Saarbrücken, Germany
{Norbert.Reithinger, Dirk.Fedeler}@dfki.de
Ashwani Kumar
LORIA,
Nancy, France
Ashwani.Kumar@loria.fr
Christoph Lauer, Elsa Pecourt
DFKI ? German Research Center for Artificial Intelligence
Saarbrücken, Germany
{Christoph.Lauer, Elsa.Pecourt}@dfki.de
Laurent Romary
LORIA,
Nancy, France
Laurent.Romary@loria.fr

Abstract In this chapter we describe the MIAMM project. Its objective is the development of new concepts and techniques for user interfaces employing graphics, haptics and speech to allow fast and easy navigation in large amounts of data. This goal poses challenges as to how can the information and its structure be characterized by means of visual and haptic features, how the architecture of such a system is to be defined, and how we can standardize the interfaces between the modules of a multi-modal system.

Keywords: Multimodal dialogue system, haptics, information visualization.

1. Introduction