Gemini Launches Application Control on Mac

Gemini is rolling out a computing pilot feature for its Mac application in the United States, available in English. The service claims it can execute repetitive tasks based on instructions describing the expected work, both on the web and within software and files on the Mac.
The user must validate each action
According to Gemini, each operation must receive the user's approval, who also determines which software the assistant can access. The execution takes place in a separate window: the company states that this separation allows the user to continue their activities without interruption.
Access is through the downloadable application at gemini.google/mac.
Le brief IA que les pros lisent chaque soir
Les 7 actus IA du jour, décryptées en 5 min. Gratuit.
Inclus dès l'inscription : notre sélection des meilleurs guides & comparatifs IA.
Choisissez votre rythme
Gratuit · Pas de spam · Désabonnement en 1 clic
From quotes to presentations, the proposed uses
The announced functionality relies on a description of the work to be done, even when it involves a complex sequence of operations. Gemini then indicates it can navigate menus, perform clicks, and fill in the necessary fields. Among the proposed uses is reading locally stored PDFs to extract addresses, weights, and dimensions, then filling in various fields of a shipping quote. For resale, the assistant could examine photographs of clothing from a folder on the Mac, search for prices, record the specifications of the items, and prepare multiple listings on the relevant platforms.
Creative examples include color correction of multiple elements in a design software and setting up complex 3D scenes. Gemini also proposes to collect indicators and live dashboard captures covering multiple regions, then compile them into a Google Slides presentation.
Brief IA — L'actualité IA en français
L'essentiel de l'actualité de l'intelligence artificielle, décrypté et expliqué chaque jour.