Selecting a projected icon, 3D model of San Francisco

TravelMATE and OfficeMATE were experimental systems that added computer information to the physical world, creating an "augmented environment."  The TravelMATE application enhanced the driving experience with informational icons projected on the windshield or on a CARS display in response to queries and the user's physical location.  With windshield icons, a user could select from available options using either speech recognition or by pointing (vision algorithms fused input from two small cameras to calculate the location of the user's finger).  On the CARS display, a high-quality high-res 3D model (courtesy of Planet9) displayed the identical scene viewable from the user's car, with augmented information overlaid on top of recognizable landmarks.

Get RealOne