Ambient Intelligence Multimedia Environments have the vision of enhancing our everyday environment and our interaction with its objects by sensing, computing, and communication capabilities. As pervasive devices grow in complexity and sophistication, they become harder and harder to use, particularly because of their tiny display screens and limited interfaces. At the same time, devices will disappear or blend into the background and will be invisible to the user. Because of this transparency, users fail to develop adequate mental concepts for the interaction with (or within) Ambient Intelligence Multimedia environments. To overcome these challenges, new interaction models are required. How can one interact with tiny devices that do not provide own user interfaces? How to find and access devices that are invisible to the user? How to access physical devices in unfamiliar environments without having knowledge about the technical infrastructure?
We explore the role of Multimedia in the above-mentioned context:
- Support new ways of interaction that apply to multiple human senses, and
- Diffuse the presentation of content in the environment.
Our research interests in this area include:
- Interacting with Ambient Intelligence
- Ubiquitous meta user interfaces
- Multi-modality, the ability of ad-hoc utilization of various categories of sensors (camera, microphone, accelerometer, etc.) for recognition of gesture, voice, mimic, and haptic input
- Multimedia, multi-modal output coordination, dynamic distribution of multi-modal representations/dialogues among available multimedia devices
- Multi-device interaction, the ability of using any available interaction device to control any other device, such as multimedia equipment, household appliances, or lecture room infrastructure.
- Device independency, device-independent realization of multi-modal interaction, such as voice and gesture recognition.
- Evaluation issues, how to evaluate the added-value of multimedia assisted interaction compared to other advanced approaches for Ambient Interaction, e.g., video-based gesture interaction vs. hardware-based gestures.