Sketch Based Interfaces

We present an innovative sketch-based interface for driving interactive applications on desktop and mobile devices. Our approach relies on recognition and constructs a semantically relevant representation of the sketch. This representation is parameterized and used to drive an output model (for example a 3D face). The main appeal of our method is that the interface is completely decoupled from the underlying facial model that is used. Therefore a single interface is capable of driving a variety of different models both 2D and 3D. The connection between our framework and the output model is defined by a library of template strokes that can be generated with ease. The method is efficient and supports mobile devices with minimal computing resources such as the Nintendo DS.

Selected publications and demos:

  1. 1.“Bringing Sketch Recognition into Your Hands”, Gabriele Nataneli, Petros Faloutsos, IEEE Computer Graphics and Applications, in press, pp. 1-9, 2009.

  2. 2. “Robust Classification of Strokes with SVM and Grouping”, Gabriele Nataneli, Petros Faloutsos, Lecture Notes in Computer Science 4841 Springer, pp. 76-87, 2007.

  3. 3. “Sketching facial expressions”, Gabriele Nataneli and Petros Faloutsos, ACM SIGGRAPH 2007 Technical Sketches, pp. 60, 2007.

Video demo: