Google Beam: The AI Revolutionizing Telepresence

An Immersive Experience with Google Beam

At the Google I/O event, I had the opportunity to discover Google Beam, a video telepresence technology that promises to transform the way we interact remotely. Seated in a climate-controlled booth, I engaged in a conversation with what appeared to be a real person. However, it was a hyper-realistic AI agent, projected on a large screen and using multiple cameras to create a striking illusion of human presence.

This technology, previously known as Project Starline, has evolved to offer 2D interaction, although it can easily be adapted for 3D rendering. Google plans to roll out Beam on a larger scale this year, in partnership with HP, primarily targeting businesses. The idea is to allow two remote individuals to feel as if they are sitting together around a table, which requires each participant to have a Beam device.

The AI Agent: A Disturbing Interaction

The unnamed AI agent surprised me with its realism and ability to interact naturally. During the demonstration, it smiled, gestured, and chatted with me casually, like a true human conversational partner. I asked the agent to generate an image of me at a New York Jets game, which it did effortlessly. It also interacted with virtual objects, like plastic bananas placed on the table, and complimented my cameraman's backpack.

This interaction, although in 2D, was one of the most realistic experiences I've had with an AI. The agent also provided search recommendations, demonstrating its ability to assist and interact smoothly. This experience left me with a disturbing impression, as the video agent, even in standard 2D, was one of the most convincing near-humans I have ever conversed with.

The Potential Uses of Beam

The question of the necessity of Beam arises as many telepresence tools already exist, from video calls on smartphones to virtual reality headsets. However, Google envisions various applications for Beam, ranging from offices to public spaces like interactive kiosks. Andrew Nartker, general manager of Google Beam, presented this technology as an experience that could be used in an office or in a public place, such as a talking interactive kiosk.

In a more whimsical tone, the demonstration made me think of amusement parks. Could a 3D AI character welcome me at a food stand in a future expansion of Disney's Star Wars Galaxy's Edge, serving me intergalactic dishes while squinting its alien face? Would a themed hotel use it to create a magical experience? Or would it be used to replace real concierges and workers in certain situations, a more advanced concept than the existing drive-in chatbot windows?

I can see all these paths at once. The Google Beam demonstration impressed, amazed, and concerned me more than almost anything else at this edition of Google I/O. The implications of this technology are vast and could transform remote interactions, potentially impacting various professional and leisure sectors.