login
Home / Papers / GPT is an effective tool for multilingual psychological text analysis

GPT is an effective tool for multilingual psychological text analysis

80 Citations•2024•
Steve Rathje, Dan-Mircea Mirea, Ilia Sucholutsky
Proceedings of the National Academy of Sciences of the United States of America

It is demonstrated that the large-language model GPT is capable of accurately detecting various psychological constructs in text across 12 languages, using simple prompts and no additional training data, and thus overcomes the limitations present in existing methods.

Abstract

Significance Many fields—including psychology, sociology, communications, political science, and computer science—use computational methods to analyze text data. However, existing text analysis methods have a number of shortcomings. Dictionary methods, while easy to use, are often not very accurate when compared to recent methods. Machine learning models, while more accurate, can be difficult to train and use. We demonstrate that the large-language model GPT is capable of accurately detecting various psychological constructs (as judged by manual annotators) in text across 12 languages, using simple prompts and no additional training data. GPT thus overcomes the limitations present in existing methods. GPT is also effective in several lesser-spoken languages, which could facilitate text analysis research from understudied contexts.