Researchers at OpenAI discovered that large language models can learn to perform tasks like basic arithmetic, even though it defies traditional understanding of deep learning. This surprising behavior, called “grokking,” has puzzled the research community. The lack of clear understanding poses challenges and risks for future AI development. Despite its potential, deep learning remains a grand scientific mystery.










