Google has announced that it is rolling out Guided Vision in Gemini Live for all compatible Android smartphones, introducing a voice-forward, real-time visual interpretation tool engineered for individuals who are blind, have low vision, or need intuitive visual help in daily life.
Developed in collaboration with the accessibility community and previewed earlier this month alongside broader Android accessibility upgrades, the feature converts Gemini into an active conversational partner capable of narrating surroundings, answering follow-up queries and offering spoken camera-framing directions.
How to setup and activate on Android
Gemini App Settings: In the Gemini mobile app, navigate to profile settings, turn on “Use Guided Vision in Live,” open Gemini Live, and tap to share the camera.
A key element of Guided Vision is its proactive framing assistance. When a user streams their phone camera during a Gemini Live interaction, the assistant analyses the view in real time. If the camera is positioned too close, tilted too high, or off-center, Gemini provides spoken guidance, such as asking the user to pan slowly to the right, tilt downward, or step back, ensuring it gets the visual clarity needed to provide precise answers. It can also give descriptive walkthroughs of unfamiliar layouts, rooms and items arranged across tabletops, and supports spoken conversations across multiple languages, incorporating feedback from blind and low-vision communities across India, Brazil, Singapore, Indonesia and Japan. Beyond assisting blind and low-vision users, the feature offers practical utility for older adults, individuals with lower literacy levels, or anyone attempting to decipher text in poor lighting.