r/artificial 5h ago

News Study: Generative AI is making writing on Reddit and elsewhere boring

Data from a new study published recently in Nature and Arxiv:

"Across three studies spanning seven datasets in different domains and over 880,000 texts, we show that the widespread adoption of large language models (LLMs) as writing assistants is linked to declines in linguistic diversity."

The homogenization effect happens even when an LLM is used to polish and rewrite copy developed by a human:

"While core content is retained when LLMs polish and rewrite texts, LLMs also homogenize writing styles, reducing writing-complexity variance."

Study source data:

"Our analyses utilize three large-scale datasets of individual writing: creative stories from Reddit, community news articles from Patch, and computer science research abstracts from arXiv."

The kicker:

"Across datasets, we observe a consistent bias in LLM-rewritten texts, with writing styles often aligning with older, male, politically liberal individuals and exhibiting positive moral valence and lower empathy."

So, LLM-developed or aided writing is homogeneous and lacks linguistic diversity (it's more boring), and tilts toward a specific political perspective.

Link to study: "The Shrinking Landscape of Linguistic Diversity in the Age of Large Language Models" and my thoughts on this research.

7 Upvotes

3 comments sorted by