world models

Do LLMs Have World Models? What Othello-GPT Shows and What It Doesn’t

Othello-GPT showed a sequence model can learn and use a hidden board state. Later work found such internal maps are often incoherent.…