What’s Trending in AI?

Learning Rate Decay Can Exponentially Accelerate SGD for Global Optimization of Nonconvex Functions · Bharat Hunt