domingo, 25 de mayo de 2008

Feedback in sketch recognition

Early on our research, we noticed that there was a slight shock for a new user when the sketch recognition system translates the pixel data into the recognized shape. A better explanation would come from a simple example:
- If you draw a rectangle, meaning to sketch a window. The system is taught to recognized rectangles as Windows. What happens next, is the visual change of your (awfully) drawn rectangle into a pretty Window. Maybe this doesn't sound really bad, but it is a bit of shock...

We have thought of a couple of ways to solve this. An interesting solution would be to have a smooth transition (morphing) from the original sketch to the desired image. Although we don't think this is desirable in all cases.

Another solution which seems to us more appropriate, is to provide near foolproof methods of feedback.
- Our current approach involves the use of color:
- Unrecognized lines appear in blue.
- Basic shapes (rectangles, circles, Xs, checks) are colored magenta.
- Finally complex (and interesting) shapes show up in black. This signals a final state of the shape.
- We've thought, although are far from implementing, about using a "virtual assistant". Much like those found in a certain popular Office suite. Our assistant would shout (in a very quite sort of way) the item that was recognized.
- Say you drew a button, the assistant will show a button drawn inside its dialog balloon. Similarly for the rest of the building blocks.
- Most consider assistants to be generally useless. We think that in this particular case, it would prove to be an extremely useful tool to provide feedback. Specially since efficient feedback, in particular, is one of the yet to be solved problems while sketching.

No hay comentarios: