OpenAI Codex Desktop: the AI that controls your Mac

⚡

Key Takeaways

1OpenAI has updated Codex Desktop, expanding its features beyond coding to include productivity tools.

2The software now allows control of a MacOS computer, running applications in the background to optimize multitasking.

3Codex Desktop integrates a browser with AI capable of understanding clicks, thereby simplifying online modifications.

💡Why it matters — This evolution positions Codex Desktop as a versatile tool, enhancing the efficiency of Mac users by automating complex tasks.

OpenAI Codex Desktop: A Leap Towards Overall Productivity

OpenAI has recently unveiled a significant update to its Codex Desktop application, expanding its scope well beyond its roots as a coding tool. Initially designed for programmers, Codex Desktop is evolving into a comprehensive productivity tool, competing with solutions like Claude Cowork. OpenAI acknowledges that Codex Desktop is still primarily aimed at programmers, but it now includes productivity tools that go beyond simple code generation.

Advanced Control of Your Mac

One of the most remarkable features of this update is Codex Desktop's ability to control a computer. On MacOS, the AI can now run applications in the background, allowing users to focus on other tasks simultaneously. This feature is currently exclusive to Mac users.

Integrated and Intelligent Browser

Codex Desktop now includes an integrated browser that, although not yet demonstrated in action by OpenAI, promises to enhance user efficiency. With the help of AI, it is possible to click on an item and request changes without having to provide lengthy explanations. For example, a simple click may suffice to request a font change, thereby simplifying online interactions.

Image Generation and Automations

While image generation is a well-established feature of ChatGPT, it is now making its way into Codex Desktop. Users will be able to create agents capable of automatically generating images, graphics, or diagrams, although the effectiveness of this feature remains to be evaluated.

Codex Desktop also enhances its automation capabilities. Now, automations can be integrated into existing conversation threads, allowing the AI to remember the context of past discussions. This improved memory enables Codex to assign tasks to itself and pursue them over several days or weeks.

Developer Features

Among other updates, Codex Desktop offers developer-specific features, such as support for responding to review comments on GitHub, managing multiple terminal tabs, and connecting to remote devboxes via SSH, although this feature is still in early testing. Users can also view files directly in the sidebar with rich previews for PDFs, spreadsheets, slides, and documents. A new summary panel allows users to track the plans, sources, and artifacts of the agent.

Availability and Precautions

The new Codex Desktop is accessible to all levels of OpenAI's Codex access, on Mac and Windows. However, the computer control feature is limited to MacOS and is not yet available in the EU. It is advisable to test the features before allowing an agent to operate unattended, as running long-term projects can quickly consume token allocations.