Google Launches Guided Vision in Gemini Live with Usage Limits

Google has made Guided Vision available on Android to audibly describe what the camera is filming. The feature arrives in Gemini Live and also integrates with TalkBack, with an accessibility shortcut available starting from Android 9. However, the company strongly regulates the uses related to safety and mobility.

Google Excludes Navigation and Obstacle Avoidance

Google recommends not to use Guided Vision for navigation, safe movement advice, or obstacle detection. The company also clarifies that this feature does not replace a cane or a mobility aid. Furthermore, Gemini can provide audio cues to help orient the camera if the object being searched for is not visible on the screen.

Availability in Gemini Live, TalkBack, and as a Shortcut

Guided Vision is available starting today in Gemini Live on compatible Android smartphones. The feature is also accessible via Google TalkBack. Users can activate Guided Vision using an accessibility shortcut in the Settings app, provided they are using a device running Android 9 or a later version. This new feature was announced in a recent series of updates for the Pixel devices.

Reading Small Text and Follow-Up Questions

By sharing the camera feed in Gemini Live, Google's AI can assist in reading small text, describing the environment, locating or identifying nearby objects, and providing information about specific items. Users can also ask follow-up questions, such as requesting Gemini to read the expiration date of a found product. This feature, similar to Apple’s VoiceOver Live Recognition on iPhone and Vision Pro, is aimed at individuals who are blind, visually impaired, or those who seek occasional assistance.