Is it human, or is it AI?
Carnegie Mellon UniversityPeer-Reviewed Publication
With the popularity of large language models (LLMs) like ChatGPT and Llama on the rise, the question is often asked whether or not these programs can accurately match the style of text written by humans. A team of Carnegie Mellon University researchers set out to answer this question, and their findings were recently published in the Proceedings of the National Academy of Sciences (PNAS). In this study, researchers were able to show how LLMs write by prompting them with extracts of writing from various genres, such as TV scripts and academic articles. The research team found large differences in grammatical, lexical and stylistic features between text written by LLMs and humans. These differences were largest for instruction-tuned models, such as ChatGPT, which undergo additional training to answer questions and follow instructions.
- Journal
- Proceedings of the National Academy of Sciences