The field of deep learning has witnessed remarkable advancements in recent years, with neural networks consistently breaking records in various domains such as computer vision, natural language processing, and beyond. However, despite their impressive performance,…
Understanding underfitting, grokking, and generalization collapse through the lens of theoretical physics and random matrix theory In recent years, machine learning (ML) models have achieved remarkable success across a wide range of applications, from image…
The rapid advancement of natural language processing (NLP) technologies, particularly Large Language Models (LLMs) like GPT-4 and Llama 3 with long-context capabilities, has opened up new possibilities for enhancing education, especially in fields where language…
