We have all seen sci-fi movies where the actor is able to interact with virtual objects in the real world. We might think that this technology only exists in the realm of fiction but as the augmented reality advances will soon come to fruition.

A recent patent publication reveals that Microsoft has developed an augmented reality system that generates a virtual environment and virtual objects in the real world. The system allows you to manipulate virtual objects using different gestures. The system is set to revolutionize office presentations. As shown in the figure above, all participants in a presentation including the presenter wear a head-mounted display (such as Hololens^TM). Then, the presenter shows 3D model of a virtual object placed on a real desk. The presenter will be able to manipulate the virtual object using his hand gestures. The participants will able to watch the virtual object moving in real-time. So, the presenter will be able to explain the virtual object in an intuitive way. This technology might end up replacing PowerPoint presentations.

It looks like this system will materialize my dream to interact with the virtual objects in the real world just like it is depicted in the countless sci-fi movies.

US20190232500