glossary//chinese-room
the Chinese room
The Chinese room is John Searle's 1980 argument that a program shuffling symbols by rule does not understand them, however well it performs.
The argument begins by granting the hardest point. A person sits in a room with a rule book, receives Chinese symbols, follows the rules, and hands symbols back. Searle stipulates that this person could pass as a Chinese speaker without understanding a word. The performance is granted at the start, and the conclusion comes after it: a program that manipulates symbols does not understand either. Summaries often run the argument backwards and present the room as a machine that cannot really hold a conversation, which is the opposite of what Searle asks you to accept.
The citation is exact. John Searle, "Minds, Brains, and Programs", Behavioral and Brain Sciences 3(3), 1980.
The standard reply is that the whole room understands. Not the person at the desk, who plainly does not, but the room as a system: the clerk, the rule book and the symbols together. Searle sends you looking for understanding in the clerk; the reply says that is the wrong place to look. Whether the argument survives the reply is not something this page settles.
In current argument the room travels with the stochastic parrot, a 2021 claim about what one technology does with statistics, and it is not that claim: it is forty-one years older and it does not care how the symbols get shuffled. The argument runs the same against a lookup table, a hand-written rule book or a neural network, because what it objects to is symbol manipulation as such. The two turn up in the same arguments, which is how they get swapped, and the swap costs you forty-one years and the generality.
The p(doom) song, annotated compresses the argument to a line, that shuffling symbols is not understanding. The song it annotates puts the question to the chatbot directly.