OpenAI Chronicle: Microsoft-Inspired Innovation Codex

OpenAI recently introduced a new feature called Chronicle in its development tool Codex, but only for Pro users on macOS. This innovation allows Codex to regularly capture users' screen content to enrich its memory. The data collected is then transformed into text summaries and stored locally as Markdown files. According to the documentation provided by OpenAI, the raw screenshots are deleted after a six-hour period.

Transforming Captures into Textual Memory

The operation of Chronicle is reminiscent of Microsoft Recall, which takes screenshots every five seconds. However, Chronicle stands out by not retaining the images themselves but by extracting text summaries that feed into Codex's context. With this approach, the tool is capable of tracking open projects, tools used, and ongoing tasks without requiring explicit descriptions from the user.

To activate Chronicle, the user must first enable memories in the Codex settings, then select Chronicle and give consent. macOS will then request the necessary permissions for screen recording and accessibility. The user can pause or disable Chronicle at any time via the menu bar.

Beyond Software Development

OpenAI envisions Codex as a versatile application capable of supporting various professions, not just developers. Chronicle fits into this vision by allowing Codex to understand a user's workflow by observing their screen, rather than just analyzing what is typed in a terminal.

Security Risks and Transparency

OpenAI has chosen not to hide the potential weaknesses of Chronicle. The official documentation highlights three main risks:

• Memory files are stored in plain text on the hard drive, without encryption.
• Other applications on the computer can access these files.
• The system is susceptible to prompt injection attacks, where a malicious website could insert instructions into the screenshots, which Codex would interpret as legitimate data.

This transparency contrasts with Microsoft's approach during the launch of Recall, which raised significant privacy concerns. Microsoft had to delay the launch by a year and encrypt its database after an outcry. OpenAI hopes that its upfront honesty will prevent a similar backlash. Greg Brockman, co-founder of OpenAI, described Chronicle as "surprisingly magical to use," although security experts have not yet had the opportunity to examine it in detail.

Geographic Limitations

Chronicle is not available for users in the European Union, the United Kingdom, or Switzerland. OpenAI has not specified whether this restriction is due to regulatory or technical reasons, but European legislation, particularly the AI Act and GDPR, strongly suggests a regulatory constraint.

Another practical challenge arises: Chronicle quickly consumes API quotas, which could deter Pro subscribers even before privacy concerns become a major obstacle.