Where Is the "Self" of a Large Language Model? -- From Self-Index to Self-Reference
Yuchen Li, Xintong Li, Zongqi Fan, Ken-tye Yong, Nguyen H. Tran
原文摘要
Whether a large language model has a self is usually argued rather than measured. We introduce a quantitative test of a functional self at two levels known from biology: a self-index that marks material as one's own, and self-reference, the ability to recognize it. We place one text in an Assistant, User, or System message of the chat template, so only its source differs. In 13 of 25 open-weight models from 14 developers, internal representations set the model's own message apart, and next-token predictions and the persistence of the difference along the message follow this self-index. No model recognizes its own messages without it (chance probability 0.004). Editing a few directions per layer that carry the index removes recognition in seven models and modes and changes the role a model takes in a game that never asks who wrote a message. Self-reference is thus a readout of the self-index.
cs.CL