Google Uses Gemini to Analyze Roads via Camera

Google Uses Gemini to Analyze the Road via Camera

What if Gemini became the eyes of your car? Google recently demonstrated an experimental feature capable of utilizing the front camera of a vehicle equipped with Google Built-in to analyze the road and respond to driver inquiries.

A little chat with an AI about what you see while driving? This could soon be possible with Gemini. Your car may soon do more than just tell you where to turn; it could also explain what it sees. Google has introduced a new experimental feature of Gemini designed for vehicles equipped with Google Built-in.

The goal of the Mountain View giant is to occasionally give its AI access to the vehicle's front camera, and possibly also the side and rear cameras, so it can answer questions from the driver or passengers about the external environment. A building, a sign, a monument, a scene visible from the road… Gemini would no longer just be a voice assistant in the cabin but a sort of co-pilot capable of looking outside.

Gemini No Longer Limited to the Central Screen

The demonstration, spotted by Android Authority, was conducted in a Volvo EX60 equipped with Google Built-in. In this example, Gemini can use the vehicle's front camera to:

• Identify a building
• Comment on a location visible from the road
• Explain a sign in a foreign language

It should be noted that this feature is not yet commercially deployed. Google has not provided a timeline or specified which models might benefit from it. But the direction is clear. Gemini is gradually replacing Google Assistant in compatible cars, with more natural responses, better contextual understanding, and greater integration with vehicle functions.

The sensitive point will obviously be privacy. However, according to Google, Gemini would not continuously monitor the road. The camera would only be shared with the AI after an explicit request from the driver, before becoming inaccessible again. We can’t wait to see it in action.