We have all seen sci-fi movies where the actor is able to interact with virtual objects in the real world. We might think that this technology only exists in the realm of fiction but as the augmented reality advances will soon come to fruition.
A recent patent publication reveals that Microsoft has developed an augmented reality system that generates a virtual environment and virtual objects in the real world. The system allows you to manipulate virtual objects using different gestures. The system is set to revolutionize office presentations. As shown in the figure above, all participants in a presentation including the presenter wear a head-mounted display (such as HololensTM). Then, the presenter shows 3D model of a virtual object placed on a real desk. The presenter will be able to manipulate the virtual object using his hand gestures. The participants will able to watch the virtual object moving in real-time. So, the presenter will be able to explain the virtual object in an intuitive way. This technology might end up replacing PowerPoint presentations.
It looks like this system will materialize my dream to interact with the virtual objects in the real world just like it is depicted in the countless sci-fi movies.
Publication Number: US20190232500A1
Patent Title: Puppeteering in augmented reality
Publication date: 2019-08-01
Filing date: 2018-01-26
Inventors: Darren Alexander Bennett, David J.W. SEYMOUR, Charla M. PEREIRA, Enrico William Guld, Kin Hang CHU, Jonathon Burnham COBB, Dean Alan WADSWORT, HWeihua Huang Current Assig
Assignee: Microsoft Technology Licensing LLC