A Spectral Theory of Grokking: Weight Decay induces Feature Learning

A Spectral Theory of Grokking: Weight Decay induces Feature Learning. Reported by arXiv. Bharat Hunt files it under AI Tools — the section covering applications people use — assistants, editors, search, productivity. Open the original report for the full detail.

Written by Bharat Hunt from the headline and the coverage below. The original reporting is the source of truth.