FRAMINGHAM 8 MARCH 2011 - Microsoft's Kinect for Xbox 360 ditched handheld controllers for gestures and sound, but natural user interfaces don't have to be restricted to video games.
"In the months and years to come, a growing number of Microsoft products will recognize voices and gestures, read facial expressions and make computing easier, more intuitive and more productive," Microsoft said.
Microsoft Research "is working closely with Microsoft business units to develop new products" using technology similar to the natural user interface exhibited by Kinect, the company said. "Computers are moving rapidly toward ... interfaces that are more intuitive, that are easier to use, and that adapt to human habits and wishes, rather than forcing humans to adapt to computers."
Several of the 17 Microsoft projects exhibited at TechFest take advantage of natural user interfaces.
Microsoft's Applied Sciences Group is working on smart, interactive displays using Kinect technology, including one that improves display of 3D images. The project uses "a special, flat optical lens (Wedge) behind an LCD monitor to direct a narrow beam of light into each of a viewer's eyes," Microsoft said. "By using a Kinect head tracker, the user's relation to the display is tracked, and thereby, the prototype is able to steer that narrow beam to the user. The combination creates a 3-D image that is steered to the viewer without the need for glasses or holding your head in place."
A related project uses a "Kinect-based virtual window," which tracks a "user's position relative to a 3-D display to create the illusion of looking through a window," Microsoft said. Along with other 3-D technologies, the Kinect-based virtual window could improve upon existing telepresence systems, Microsoft said.
Natural user interfaces represent just a few of the projects Microsoft is displaying at TechFest. Here are some more examples:
• Face recognition in video. "In the near future, a television or an Xbox will be able to recognize people in the living room, home video will be annotated automatically and become searchable, and TV watchers will be able to get information about an unfamiliar actor, athlete, or singer just by pointing to the person on the screen," Microsoft says.
• Take 3-D pictures with a regular camera. Watching 3-D content is one thing, but creating your own is another. Microsoft is demonstrating technology that can create 3-D images with normal cameras. "Our research demonstrates an easy-to-use system for creating photorealistic, 3-D-image-based models simply by walking around an object of interest with your phone, still camera, or video camera," Microsoft says. A user can view newly created 3-D images "by spinning it around on your screen, tablet or mobile device."
Sign up for CIO Asia eNewsletters.