Multimodal Content Adaptations for Heterogeneous Devices

Susan W. McRoy, Songsak Channarukul, Syed S. Ali

Abstract


We present Multiface, a multimodal dialog system that allows users to interact using different devices such as desktop computers, PDAs, and mobile phones. Users can request information and will receive multimodal responses, where the presented content and its modality are customized to individual and the device they are using. In addition, the system will attempt to assess the user's understanding and adapt its future responses accordingly. Multiface uses a plan-based approach to produce adaptive content and modalities from an annotated document and models of the user
and device.

Full Text: PDF