Lenovo's new Phab2 Pro, developed with Google, brings augmented reality to smartphone screens without the need for a headset.
The device, which has a 6.4-inch screen, pushes smartphone functionality to new heights. The giant display presents a wealth of information that changes how people interact with the physical world around them.
The smartphone, based on Google's Project Tango computer vision technology, will ship worldwide in August and become available in September for US $499, Lenovo announced Thursday. It's loaded with cutting-edge sensors, cameras, and a Snapdragon 652 processor from Qualcomm.
The device can be used to measure distances, recognize items, map locations, and provide real-time indoor navigation.
By integrating Tango in Phab2 Pro, Lenovo "can provide enhancements to everyday user experiences that will be so valuable that it's almost second nature," Jeff Meredith, vice president and general manager of Android and Chrome Computing at Lenovo, said in an interview.
Google said Phab2 Pro is the first Project Tango device, and many more will come.
"With a Tango-enabled phone, you also have a toybox, a solar system, and a pet shop in your pocket. You can play with a huge set of dominoes, explore the planets, defend yourself from invading aliens, or feed your virtual dog all through your phone," Google said.
One goal with Phab2 Pro is to enhance indoor navigation, where GPS typically does not work well. In a museum, the smartphone could guide a user to a specific painting and display information about the artist and the work.
The smartphone could also guide a person to a specific booth in a convention center, something conventional navigation systems can't do.
Gaming will reach new heights on the Tango smartphone, Meredith said. Users can play augmented reality games by superimposing graphics on real-world backgrounds. Imagine playing a shooter game with the world around you as the background.
Someone remodeling their kitchen could superimpose pictures of furniture and cabinets, in different colors, onto an image of the actual room. The Phab2 Pro previews what the new kitchen would look like.
Lenovo is partnering with home improvement retailers Lowe's and Wayfair. With Wayfair's app, for instance, you could use the Phab2 Pro to preview new furniture for your living room.
The augmented reality is made possible by a unique set of hardware and sensors in the smartphone. The handset establishes location and contextual awareness by understanding the device's position, plus motion, images, and location, Meredith said.
That input is delivered to special software tied to Project Tango installed in the handset, which runs the Android 6.0 OS.
The back of the smartphone has a motion-tracking sensor, a fish-eye camera, a depth sensor, and a regular RGB camera, which can provide a broad 150-degree view. The smartphone also has a 5-megapixel front camera.
Sign up for CIO Asia eNewsletters.