Claude AI Controls Macs: Promising Advances and Challenges

Claude AI: A New Era for Mac Control

Claude AI, developed by Anthropic, has recently introduced a groundbreaking feature that allows artificial intelligence to take control of your computer screen to perform various tasks. This technological advancement enables Claude to navigate your screen, interact with your applications, and manage your files and settings autonomously. Currently in "research preview" phase, this capability is available to Mac users subscribed to the Claude Pro and Max plans.

Features and Limitations of Claude AI

Claude AI offers the ability to control your computer to accomplish tasks autonomously, but this feature is limited to certain users. Only subscribers of the Claude Pro and Max plans can benefit from it, leaving out users on the free, Team, or Enterprise plans. Additionally, this capability is currently reserved for Mac users, although Anthropic has announced future support for Windows.

To ensure security, Claude requires specific permissions and constant supervision. For example, the AI avoids interacting with sensitive applications or collecting personal information such as facial images. Claude captures the screen to learn how to navigate, meaning it can see and record all visible information. Therefore, it is crucial to ensure that confidential data is not displayed while using this feature.

How to Use Claude AI to Control Your Mac

For subscribers of the Claude Pro or Max plans who own a Mac, here’s how to activate this feature:

1. Install the Claude Mac Application
   Go to the Claude download page and download the application for macOS. Once installed, open the application, enter your email address, and follow the verification steps to log in.

2. Configure Necessary Settings
   In the Claude application, go to Settings and select General under the Desktop Application section. Enable the "Keep Computer Awake" option to prevent your Mac from sleeping while Claude is working. Under Computer Usage, enable the option allowing Claude to take screenshots and control your keyboard and mouse in authorized applications.

3. Submit a Request
   Once the settings are configured, return to the main screen and click the button for Cowork or Code if you want Claude to create an application. Type your request and submit it.

Examples of Tasks Performed by Claude

To test Claude's capabilities, several tasks were assigned to it:

• Searching for Recent Files
  Claude was tasked with opening Finder, navigating to the Documents folder, and listing the five most recent files. After obtaining the necessary permissions, Claude successfully executed the task, sorting the files by date.

• Summarizing the Schedule
  Another request involved opening the Calendar app and summarizing the schedule for March. Claude accessed the calendar, listed appointments week by week, and provided a useful summary of the month's events.

• Creating a Note
  Claude was also asked to open the Notes app, create a new note titled "Test Claude," and write a to-do list for a morning exercise routine. After authorization, Claude created the note with items such as drinking a glass of water after waking up and doing light stretches.

• Drafting an Email
  Finally, Claude opened the most recently modified document in the Documents folder, summarized its content, and then drafted a new email with that summary as the body of the message.

Evaluation and Perspectives of Claude AI

Overall, Claude executed each task accurately. Even when faced with obstacles or errors, the AI managed to overcome them to achieve the expected results. However, some criticisms remain:

• The permissions granted to Claude to access an application are valid only for the current session. To access the same application for another request, permission must be granted again. While this enhances security, an option for permanent authorization would be desirable.

• The process can be slow, even for simple tasks. For example, finding the five most recent files in the Documents folder was quicker manually than via Claude. However, Claude's true strength lies in its ability to execute a series of complex tasks from a single request.

In conclusion, Claude AI's computing skills are promising and could transform the way we interact with our computers. However, improvements are needed to optimize speed and efficiency while maintaining a high level of security.