Developer will get Google Lens working in VR to research digital objects [Video]
Phasedragon on Twitter yesterday shared efficiently utilizing Google Lens in a VR setting. The scene in query is filled with Korean textual content that Lens — in a phone-sized floating window — was capable of natively translate utilizing the filter announced at I/O 2019.
Just like in the true world, the interpretation is overlaid over the digital scene to protect context. While the principle level of this Google Lens VR demo is exhibiting the instrument recognizing even the unreal, it additionally does a great job of demonstrating Google’s AR overlay capabilities. In the video, It’s working fairly properly on indicators, posters, and different lengthy types of texts.
Behind-the-scenes, Phasedragon says that they “just hooked together a few apps” and “didn’t really do anything myself other than try a bunch to see which ones worked.”
So I received google lens working in VR 👀 pic.twitter.com/rFCS7nUgbx
— Phasedragon (@Phasedragoon) August 22, 2019
At a high-level, third-party software program captures the VR view and exports it as a digital digicam feed for Lens, which is operating in Android Studio. The tinkerer notes how they “tried microsoft translate” for this undertaking, however “it’s simply not as good as google lens.”
It speaks to Google Lens’ versatility in not making a distinction between what’s actual and digital. As lengthy as Google is introduced with a picture, Lens can leverage its machine studying prowess to research what’s in entrance of it. Google Lens is accessible on Android and iOS by way of the Google Search app.
— Phasedragon (@Phasedragoon) August 23, 2019
More about Google Lens: