Developer will get Google Lens working in VR to research digital objects [Video]

With Google Lens, you may search by pointing your digicam at the true world and entry helpful “filters” to repeat or translate textual content. The visible lookup characteristic additionally occurs to work in digital actuality as a cool demo this week revealed.

Phasedragon on Twitter yesterday shared efficiently utilizing Google Lens in a VR setting. The scene in query is filled with Korean textual content that Lens — in a phone-sized floating window — was capable of natively translate utilizing the filter announced at I/O 2019.

Just like in the true world, the interpretation is overlaid over the digital scene to protect context. While the principle level of this Google Lens VR demo is exhibiting the instrument recognizing even the unreal, it additionally does a great job of demonstrating Google’s AR overlay capabilities. In the video, It’s working fairly properly on indicators, posters, and different lengthy types of texts.

Behind-the-scenes, Phasedragon says that they “just hooked together a few apps” and “didn’t really do anything myself other than try a bunch to see which ones worked.”

At a high-level, third-party software program captures the VR view and exports it as a digital digicam feed for Lens, which is operating in Android Studio. The tinkerer notes how they “tried microsoft translate” for this undertaking, however “it’s simply not as good as google lens.”

It speaks to Google Lens’ versatility in not making a distinction between what’s actual and digital. As lengthy as Google is introduced with a picture, Lens can leverage its machine studying prowess to research what’s in entrance of it. Google Lens is accessible on Android and iOS by way of the Google Search app.

More about Google Lens:

Check out 9to5Google on YouTube for more news: