Google Lens is capable of analyzing virtual objects as well, shows a newly released video

Google Lens, with its image recognition technology, identifies the real-world objects when the camera is pointed at them, and filters can be used to copy or translate various texts. However, exciting new use of visual feature was shown in a video where Lens surprisingly worked with virtual reality game.

In a tweet, Phasedragon shared the successful experiment where Google Lens could be seen compatible in Virtual Reality.

The video showed a Lens in a phone-sized floating window that natively translated Korean with the help of filters introduced at I/O 2019.

The translation, as in the real world, was overlapped in a virtual environment to conserve its context. The VR demo of Google Lens proved that it does not only work in real-world but is capable of recognizing in the digital world as well. It also showed the AR overlay capabilities of Google.

Google Lens could be seen in the video, recognizing and translating different signs, posters, and various long forms of texts.

Phasedragon said they did not put any extra effort instead only joined a few apps together and analyzed which of them worked the better.


Microsoft translate was also tried, but it failed to produce better results than Google Lens. A third party software was used to record the VR view and then transfer it as virtual camera feed for Lens.

Google Lens does not differentiate between real and virtual environment, as discovered in this experiment. It uses its machine learning ability to analyze wherever the camera is pointed. Google Lens is available on Play Store and Apple App Store through the Google Search app.



Read next: The new hand-tracking AI by Google could be the new revolutionary product for speech impaired people
Previous Post Next Post