AI stories preferred to human-written ones - study

News imageEPA/Shutterstock The ChatGPT logo on a phone screen.EPA/Shutterstock
Researchers used three fictional short stories written by published authors, alongside three generated by ChatGPT

Readers gave the highest ratings to stories created by artificial intelligence (AI), believing they had been written by humans, according to new research.

The study, published by Cambridge University Press, tested to see whether people aged 18 to 81 could tell the difference between human-written and AI-generated short stories.

Led by researchers at Villanova University (VU), USA, it found that participants could not tell which was which.

Senior author Dr Deena Weisberg, from the department of psychological and brain sciences at VU, said: "I'd say that public assumptions about AI's capabilities are increasingly out of date."

The study also examined how participants rated the appeal and quality of each story and whether they could identify AI-generated content.

"We assume creative writing requires uniquely human qualities, such as emotional understanding and lived experience, which leads people to underestimate AI's capabilities," Weisberg added.

Researchers used three fictional short stories written by published authors, alongside three generated by ChatGPT.

In their first experiment, 1,682 participants read a story and were either correctly or incorrectly told it had been written by AI or a human. They then rated how engaging it was and its quality.

News imageIn the foreground is a large wooden bookcase which has several rows of books on it. In the background there are rows of bookshelves stocked with books.
The study tested to see whether people could tell the difference between human-written and AI-generated short stories

In a second and third experiment, 424 and 481 people received one human-written story and one by AI, and were not told the author. After reading, they were asked to identify them.

Weisberg said: "In our study, participants gave the highest ratings to stories that they had been told were written by humans but which were actually written by AI.

"I'd argue that this reveals a bias towards narratives written by real people."

Researchers also found that people who said they had greater AI literacy were better able to identify AI-written text, but participants who said they had greater expertise in literature were not.

Participants were also asked to rate their experience with fictional literature and using AI platforms, with AI-generated stories receiving a higher rating for quality.

"AI writing tends to be clearer, more direct and easier to process," said Weisberg.

"By contrast, human-written stories are often more subtle and complex.

"Perhaps people generally prefer predictability, because difficult or subtle material requires more brain power."

Do you have a story suggestion for Cambridgeshire? Contact us below.

Follow Cambridgeshire news on BBC Sounds, Facebook, Instagram and X.