This Is The Face Tracking Tech Powering Amazon’s New 3D Smartphone

Rumor has it – and we’ve confirmed – that Amazon will launch its first smartphone on June 18. The device will be unique in the marketplace thanks to its ability to deliver 3D effects courtesy of four front-mounted IR cameras. What wasn’t known is how Amazon planned to scan our faces to handle the UI elements. TechCrunch has learned that Amazon is usingOmron’s Okao Vision face sensing technology to track the user’s head. The Japanese firm’s technology was modified by an internal team at Amazon to allow its upcoming phone to deliver unique stereoscopic effects from a standard LCD screen.

For example, as I previously reported, a user can tilt the smartphone or their head left or right to browse and access hidden side panels. Watch the video (below) Amazon released along with the invitation to its launch event. Our source tells us that sort of motion is exactly how the technology works.

As we originally reported last year, his effect is done by the use of four front-mounted cameras placed at each corner of the device. The Okao face detecting and tracking software derives X, Y, and Z coordinates from the stereo-aligned cameras. The phone’s gyro sensor and accelerometer enables the Okao software to provide a faster response and increased accuracy and power efficiency.