[2210.15303] Can language models handle recursively nested grammatical structures? A case study on comparing models and humans

How should we compare the capabilities of language models (LMs) and humans? I draw inspiration from comparative psychology to highlight some challenges. In particular, I consider a case study: processing of recursively nested grammatical structures. Prior work suggests that LMs cannot handle these structures as reliably as humans can. However, the humans were provided with instructions and training, while the LMs were evaluated zero-shot. I therefore match the evaluation more closely. Providing large LMs with a simple prompt -- substantially less content than the human training -- allows the LMs to consistently outperform the human results, and even to extrapolate to more deeply nested conditions than were tested with humans. Further, reanalyzing the prior human data suggests that the humans may not perform above chance at the difficult structures initially. Thus, large LMs may indeed process recursively nested grammatical structures as reliably as humans. This case study highlights how discrepancies in the evaluation can confound comparisons of language models and humans. I therefore reflect on the broader challenge of comparing human and model capabilities, and highlight an important difference between evaluating cognitive models and foundation models.

How should we compare the capabilities of language models (LMs) and humans? I draw inspiration from comparative psychology to highlight some challenges. In particular, I consider a case study: processing of recursively nested grammatical structures. Prior work suggests that LMs cannot handle these structures as reliably as humans can. However, the humans were provided with instructions and training, while the LMs were evaluated zero-shot. I therefore match the evaluation more closely. Providing large LMs with a simple prompt -- substantially less content than the human training -- allows the L

related reading

• Recursive Language Models | Alex L. Zhangalexzhang13.github.io
• Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
• the-illusion-of-thinking.pdfml-site.cdn-apple.com
• Discovering Language Model Behaviors with Model-Written Evaluations — LessWronglesswrong.com
• Large Language Model: world models or surface statistics?thegradient.pub
• Against LLM Reductionism — LessWronglesswrong.com
• Do large language models understand us? | by Blaise Aguera y Arcas | Mediummedium.com
• Language Modelinglena-voita.github.io
• The bitter lesson of LLM evalsparsed.com
• larger language models may disappoint you [or, an eternally unfinished draft] — LessWronglesswrong.com
• Language Models can Solve Computer Tasksarxiv.org
• 2305.07759arxiv.org