[English] [Japanese]

Visualizing User Operation History Using Annotation Images

We propose the annotated history, which visualizes the operation history as a sequence of static images. Each image is composed of multiple screen snapshot with annotations such as arrows, sticky notes, and text describing a series of user interactions. The advantage of this annotated history is that dynamics of operations such as sketch and gesture are shown together with visual states, making it easier to track and identify specific visual events. The system automatically creates an annotated history without modifying the target application by monitoring user interactions. We evaluated the proposed method through a user study with multiple applications, and found that it improved user performance.


[Home] Copyright (c) 2007-2008 Toshio Nakamura