AI Writing Captivates, But It Draws from Our Own Style

A Revelatory Study on AI Writing

A recent study conducted by Cambridge University Press and researchers from Villanova University sheds light on an intriguing trend: people seem to prefer texts generated by artificial intelligence, not for their technological origin, but because they resonate with what is perceived as a human style. This research, which involved a large panel of participants, raises questions about the perception of writing and reader expectations.

The study gathered 1,682 participants aged 18 to 81. They were invited to read several fictional stories, tasked with determining which were produced by AI and evaluating the quality of each narrative. This approach aimed to understand whether readers could truly distinguish between a human pen and a machine.

Three Experiments to Probe Preferences

The study unfolded in three distinct phases. In the first, each participant received a story, with some being informed it was from an AI and others that it was the work of a human. They then had to judge the quality and engagement of the text. The second and third experiments divided participants into two groups, one of 424 people and the other of 481. Each group read a story written by a human and another by ChatGPT, without knowing which was which, and had to identify which they thought was generated by AI.

The results showed a marked preference for stories generated by ChatGPT, especially when participants mistakenly believed they had been written by humans. More than 60% of participants in the second experiment and over 48% in the third failed to correctly identify the origins of the texts.

Biases Favoring Human Writing

Deena Weisberg, a professor in the Department of Psychological and Brain Sciences at Villanova University and the lead author of the study, emphasized that these results reveal a bias in favor of narratives perceived as written by humans. According to her, this trend stems from the idea that creative writing requires unique human qualities, such as empathy and personal experience. She adds that public perceptions of AI capabilities are increasingly outdated.

Why Does AI Writing Appeal So Much?

Evidence is mounting that people are increasingly appreciating AI-generated writing, whether for short stories, essays, or poetry. A 2023 study conducted by Renee Richardson Gosline from MIT also found that AI-generated content and augmented AI, where AI makes the final decision with human reference, were often perceived as of better quality than those produced by human experts and augmented human experts.

Weisberg suggests that this preference might be due to the direct and explicit nature of AI texts, which contrast with the complexity and subtlety often present in human writing. For example, an excerpt from an AI-generated story describes a scene simply and directly: “So now, as I sit by the pond, the autumn leaves gently falling around me, I think of my mother, the stories she shared, the wisdom she imparted. The koi continue their dance beneath the water's surface, unaware of the changes they have witnessed in my life. And in their simple, unchanging world, I find a certain comfort, a reminder that life, in all its complexity and uncertainty, goes on.”

In comparison, a story generated by a human contains a more complex passage: “Perhaps, I think, we are all living some sort of birth after all, her giving birth and me witnessing, her husband playing the role of the nervous father, not knowing what he will do after the sacred event has occurred, not knowing what to do now. We swim in anxious circles around each other, and meanwhile, the golden sun continues to rise and set, keeping its own mysterious time.”

The Impact of AI on Perception of Writing

Ultimately, the preference for AI writing does not reflect a lack of taste on the part of readers nor a superiority of AI skills. On the contrary, these systems are trained on human writings that we have long appreciated and consumed. Thus, AI writing incorporates styles and tropes that are already familiar and valued.

Weisberg concludes that while there is often talk of a literacy crisis and the influence of modern media, the results of this study cannot be entirely attributed to these factors. Rather, it is an amplification of existing trends, rather than their creation.