Perceptual User Interfaces

Click here for more information on Perceptual User Interfaces.

See the special section on Perceptual User Interfaces in the March 2000 issues of Communications of the ACM, edited by Matthew Turk and George Robertson.

Work in perceptual interfaces requires both progress in individual areas and integration among areas.  Vision, speech and sound recognition, speech and sound synthesis, graphics and visualization, user modeling, haptics, and cognitive psychology are some of the disciplines that we are seeking to bring together under a common research agenda.

The work on Bayesian systems at MSR (and other places) is a good starting point for integration of information.  We are looking at incorporating vision, speech, and other modalities with Bayesian inference, learning the appropriate conditional probabilities through experience.