machine learning theory

Grokking in Neural Networks: Why Generalization Arrives Late

Networks sometimes memorize their training data and only generalize thousands of steps later. This article weighs the competing explanations for grokking and…