August 30th - September 3rd

German-Israeli Minerva School for Ubiquitous Display Environments: Intelligent Group Interaction, Foundations and Implementation of Pervasive Multimodal Interfaces



German-Israeli Minerva School for Ubiquitous Display Environments: Intelligent Group Interaction, Foundations and Implementation of Pervasive Multimodal Interfaces

August 30th - September 3rd

Organized by Antonio Krüger and Tsvi Kuflik

Main Page 


Minerva School book



Abstracts and Reading Materials

The Design, Deployment and Evaluation of Situated Display based Systems to Support Coordination and Community

Course Abstract:


Reading materials:

Gregory D. Abowd & Elizabeth D. Mynatt (2000). Charting past, present, and future research in ubiquitous computing. ACM Transactions on Computer-Human Interaction (TOCHI). March 2000, Volume 7 Issue 1, pages 29-58.

Taylor, N., Cheverst, K., Dix, A., Race, N. Fitton D., Rouncefield, M. and Graham, C. Probing Communities: Study of a Village Photo Display, in Proc. of International Conference of the Australian Computer-Human Interaction Special Interest Group (OzCHI07), November 2007.

Cheverst, K., A. Dix, C. Graham, D. Fitton and M. Rouncefield, Exploring Awareness Related Messaging through Two Situated Display based Systems, in Special Issue of Human-Computer Interaction, Volume 22, Number 1-2. pp. 173-220. June 2007.

full list here


Context-sensitive Display Environments

Antonio Krüger

Course Abstract:

In this presentation I will explore the design-space of display environemts by showing various pieces of research that investigate the usage of displays, which can be either installed in the environment or carried by the user. In particular I will elaborate on the influence of context and on how these systems are used by users in different situations. We will have a look at existing research on indoor/outdor display systems as well as mobile displays and portable perojectors.

Reading materials:

Johannes Schöning, Frank Steinicke, Antonio Krüger, Klaus Hinrichs, Dimitar Valkov: Bimanual Interaction with Interscopic Multi-Touch Surfaces. INTERACT 2009: 12th IFIP TC13 Conference in Human-Computer Interaction , (2009)

Michael Rohs, Johannes Schöning, Martin Raubal, Georg Essl & Antonio Krüger: Map Navigation with Mobile Devices: Virtual versus Physical Movement with and without Visual Context. ICMI 2007: Proceedings of the 9th International Conference  on Multimodal Interfaces, (2007)

Christian Kray, Antonio Krüger, Christoph Endres: Some Issues on Presentations in Intelligent Environments. EUSAI 2003: 15-26

Audience Measurement for Digital Signage

Jörg Muller


Course Abstract:

Audience Measurement is concerned with measuring how the audience reacts to different media like posters or TV. Traditionally, most interest was in how many people view a certain content. With digital
signage, knowing how the audience reacts to the signs in different situations enables much more powerful responses. The signs can automatically select content that people would be interested in the
current situation, or could respond to the immediate reaction of the audience (like their facial expression). In this course, the most important technologies for audience measurement will be presented, as
well as some exemplary applications.


Reading materials:

Müller et al.:ReflectiveSigns: Digital Signs that adapt to audience
attention. Pervasive 2009.
Peltonen et al.: It's mine, don't touch!: Interactions at a large
multi-touch display in a city centre, CHI 2008.
Huang et al.: Overcoming Assumptions and Uncovering Practices: When
Does the Public Really Look at Public Displays? Pervasive 2008.
Schmidt et al.: Creating Log Files and Click Streams for
Advertisements in Physical Space (Poster), Ubicomp 2008.
Müller, Krüger: Learning Topologies of Situated Public Displays by
Observing Implicit User Interactions. HCI (6) 2007: 158-167


Shared interfaces for co-located interaction

Massimo Zancanaro

Course Abstract:

Recently, colocated collaborative work around shared surfaces has become a major topic in the research agenda in the field of teamwork. These systems are based on large interactive surfaces placed horizontally (in this configuration they are usually called tabletop devices) or vertically (often called wall displays) on which a specifically designed interface is displayed or projected.  They represent a radical shift from the paradigm of one user/one computer. As such, they are subject to different design constraints than standard graphical user interface (GUI) applications.
New interaction design challenges arise for such technologies: interacting with these applications may monopolize attention and distract people from their primary activity of working together. They may therefore interfere with existing work and learning practices instead of enhancing them. On the other hand, these systems open up new possibilities for fostering collaboration.
In this talk, we will introduce the basic characteristics  of shared interfaces and present some devices that support them. We will then discuss some case studies of shared interfaces in the context of technology-enhanced learning.

Shared Interfaces for Co-located Interaction(doc)

Shared Interfaces for Co-located Interaction - slides (pdf)



Reading materials:

1. A CoLocated Interface for Narration to Support Reconciliation in a Conflict: Initial Results from Jewish and Palestinian Youth.

2. Enhancing social communication of children with high functioning autism through a co-located interface.

3. Cooperative Gestures: Multi-User Gestural Interactions for Co-located Groupware

4. System Guidelines for Co-located, Collaborative Work on a Tabletop Display


Pervasive computing in virtual environments for learning and rehabilitation

Tamar Weiss

Course Abstract:


Reading materials:

1.The Design of a Collaborative Interface for Narration to Support Reconciliation in a Conflict

2. Enhancing social communication of children with high functioning autism through a co-located interface



Jonna Häkkilä

Course Abstract:

User Centric Design of Mobile Applications – Industry Perspective

Mobile phones have become one of the truly ubiquitous devices in our everyday life offering access to numerous types of applications and services virtually anytime, anywhere. The characteristics of the devices set challenges to human-computer interaction (HCI) designers not only because of the restrictions set by mobile phone’s physical limitations and inferior computing power, but also because of the demand to create products for large and multicultural audiences. The intention of this lecture is to offer insight to the practicalities of the user centric design of mobile applications, and look through examples of hands-on HCI work in mobile phone industry.


Reading materials:



Personalization through the Analysis of Personal Information: Balancing Privacy Challenges and Economic Advantages

Tal Zarsky

Course Abstract:


Reading materials:

1. Desperately Seeking Solutions: Using Implementation-Based Solutions for the Troubles of Information Privacy in the Age of Data Mining and the Internet Society, 56(1) Maine Law Review 13-59 (2004). pdf

2. Mine Your Own Business! Making the Case for the Implications of the Data Mining of Personal Information in the Forum of Public Opinion, 5 Yale Journal of Law and Technology 1-57 (2002-2003). pdf


User Modeling for Instrumented Environments

Dominikus Heckmann

Course Abstract:


Reading materials:

1. RDF Primer

2. The User Model and Context Ontology GUMO revisited for future Web 2.0 Extensions Dominikus Heckmann, Eric Schwarzkopf, Junichiro Mori, Dietmar Dengler, Alexander Kröner Contexts and Ontologies: Representation and Reasoning, 2007, pp.37-46

3. UbisEditor 3.0: Collaborative Ontology Development on the Web Matthias Loskyll, Dominikus Heckmann, Ichiro Kobayashi Web 3.0: Merging Semantic Web and Social Web, Workshop at Hypertext 2009

4. OWL Primer

5. : feel free to login and browse the beta version of ontologies like the UbisEarth


Challenges and Solutions for Ubiquitous User Modeling

Tsvi Kuflik

Course Abstract:

In today's information world, small personal computerized devices, such as PDAs, smart phones and other smart appliances, become widely available and essential tools in many situations. The ongoing penetration of computers into everyday life leads to so-called ubiquitous computing environments, where computational power and networking capabilities are available (and used) everywhere to support the environment’s “inhabitants”. The strive of providing personal services to users made user modelling capability an essential part of any ubiquitous application. Ubiquitous user modelling describes ongoing modelling and exploitation of user behaviour with a variety of systems that share their user models. It differs from generic user modelling by three additional concepts: ongoing modelling, ongoing sharing and ongoing exploitation. Systems that share their user models will improve the coverage, the level of detail, and the reliability of the integrated user models and thus allow better functions of adaptation. Thus, ubiquitous user modelling implies new challenges of interchangeability, scalability, scrutability and privacy.


Reading materials:

1. Shlomo Berkovsky, Tsvi Kuflik, Francesco Ricci, 2008. “Mediation of user models for enhanced personalization in recommender systems”. User modeling and User Adapted Interaction Vol. 18 (3), pp 245-286. (doc).

2. Mediation of User Models for Enhancing Personalized Services Delivery (pdf)

3. Analyzing Museum Visitors' Behavior Patterns (pdf)


Analyzing Museum Visitors' Behavior Patterns

Massimo and Tsvika

Course Abstract:

Abstr act. Many studies have investigated personalized information presentation in the context of mobile museum guides. In order to provide such a service,information about museum visitors has to be collected and visitors have to be monitored and modelled in a nonintrusive manner. This can be done by using known museum visiting styles to classify the visiting style of visitors as they start their visit. Past research applied ethnographic observations of the behaviour of visitors and qualitative analysis (mainly site studies and interviews with staff) in several museums to define visiting styles. The current work validates past ethnographic research by applying unsupervised learning approaches to visitors classification. By providing quantitative empirical evidence for a qualitative theory we claim that, from the point of view of assessing the suitability of a qualitative theory in a given scenario, this approach is as valid as a manual annotation of museum visiting styles.


Embedded interaction with display environments

Albrecht Schmidt


Course Abstract and Reading materials:

my blog in link



Aesthetics in Human-Computer Interaction

Course Abstract:


Reading materials:



Multiagent negotiations in group interaction

Sarit Kraus


Course Abstract:


Reading materials:

Survey: Raz Lin and Sarit Kraus. Automated Negotiations: Can Automated Agents Proficiently Negotiate with Humans? Communications of the ACM (to appear).

KBAgent: Yinon Oshrat, Raz Lin, Sarit Kraus Facing the Challenge of Human-Agent Negotiations via Effective General Opponent Modeling,  Proc of AAMAS 2009, 377-384.

Training people with automated agents:  Raz Lin, Yinon Oshrat, Sarit Kraus, Investigating the Benefits of Automated Negotiations in Enhancing Negotiation Skills of People,  Proc of AAMAS 2009, pp. 345-352.

CT game: Barbara J. Grosz, Sarit Kraus, Shavit Talman, Boaz Stossel and Moti Havlin. The Influence of Social Dependencies on Decision-Making. Initial investigations with a new game. Third International Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), New York, NY, July 2004

Social learning in CT: Ya'akov Gal, Avi Pfeffer, Francesca Marzo and Barbara J. Grosz. Learning Social Preferences in Games. National Conference on Artificial Intelligence (AAAI), San Jose, California, July 2004.

Management interruption in teams using learning: Tammar Shrot, Avi Rosenfeldy and Sarit Kraus. Leveraging Users for Efficient Interruption Management in Agent-User Systems. Proc. of IAT 2009.