OpenAI Revolutionizes Codex: macOS Control and Persistent Memory

⚡

Key Takeaways

1OpenAI has launched an update to Codex, allowing the agent to control the macOS desktop and interact with applications.

2The new "computer use" feature is currently available only for macOS users, with an expansion planned for Europe and the UK.

3Over 90 new plugins, including those for Atlassian and GitLab, enhance Codex's capabilities, facilitating continuous integration and project management.

💡Why it matters — This update to Codex by OpenAI could transform the way developers interact with their digital tools, increasing efficiency and customization.

OpenAI Intensifies Competition with Codex

In a context where the rivalry between OpenAI and Anthropic is intensifying in the field of AI-assisted coding, OpenAI has recently announced a significant update to its Codex agent. Used weekly by over three million developers, according to figures provided by the startup, Codex is now capable of managing a Mac's desktop in the background, generating images, and remembering preferences from previous sessions.

Codex Takes Over the macOS Desktop

The flagship feature of this update is "computer use." Thanks to this advancement, Codex can now visualize the screen, move the cursor, click, and type text in any macOS application, whether it's native software like Mail or Finder, or professional tools without APIs. Multiple agents can operate simultaneously, all in the background, without disrupting ongoing activities.

OpenAI stated, "We want to bridge the gap between what people can imagine and what they can build." Additionally, the application includes a browser that allows for direct annotation of pages to provide precise instructions to the agent. Currently, this feature is primarily aimed at front-end development and gaming, with the goal of expanding browser control beyond local applications.

Limited Availability

For now, the "computer use" feature is limited to macOS users. However, OpenAI plans to extend this availability to users in Europe and the UK in the near future. Customization features, such as memory and contextual suggestions, are initially reserved for Enterprise and Edu subscribers.

Enrichment with 90 New Plugins

The Codex update also introduces over 90 new plugins, which complement those launched at the end of March. Notable additions include Atlassian Rovo for JIRA management, CircleCI and CodeRabbit for continuous integration and code review, as well as GitLab Issues, Microsoft Suite, Neon by Databricks, Remotion, and Render.

Codex is now capable of generating and iterating images directly within the workflow, thanks to gpt-image-1.5. OpenAI cites use cases such as creating mockups, product visuals, and assets for games.

Persistent Memory and Advanced Automation

OpenAI has also launched a preview version of Codex's new memory. The agent can now retain preferences, corrections, and information collected during previous sessions. This means that future tasks can rely on an already established context, without requiring new detailed instructions. Automation capabilities have also been enhanced, with Codex now able to "schedule future work" and automatically resume tasks "over multiple days or weeks," using existing conversation threads and connected plugins, such as Slack, Gmail, and Notion.

Codex can now suggest how to start your workday or where to pick up an ongoing project, thereby offering increased personalization and optimized efficiency for users.